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I. INTRODUCTION 


oS == a ee Se ee ee ec 


A. PURPOSE 


The purpose cf this thesis was to perform an assessnent 
of the current attitudes and perceptions of U.S. Ccast Guard 
officers concerning the recentiy implemented Off3 


2S) 
Performance Manacement System (OPMS). This assesment was 
u 


accomplished by wtsing the results of a survey instrumerncs 
designed and administered by the author to a sample of 
five-hundred (50C) Coast Guard officers. The resultant 


analyses depicted areas of ccmmcn perception as weil as 
areas of diversified opinion. 

Cne hope guicing this thesis effort was 
ings would support the optimism expressed by the Coasz Gazird 
Headquartes Staff, (G-OPES), that the OPMS is w 
Meeenie Criicer cecrps. If this were indeed the case, tneéen 
ms thesis would iend credence to the optimistic attitudes 
Cr the Headquarters Stare. 

if the survey results turned out to 


D 
however, then it would appear that the Of 


Boel pelt erneace 
Management System (OFMS) might be encountering resistance by 
mee, Ctiticer corps. Heperully, the survey resuits would 


identiry areas of significan* resistance if they exist. 


Mecewlse, areas cE significant support for the OPMS could be 


The basic hypothesis of thi 


s 
mermmilass Of the Coast Gtard offic 


Ex coryns in generai are 
consistent with the cpinions expressed by stazf elements of 


Coast Guard Headquarters, (G-2-3), reléetive to the accer- 
tance and efficacy of OPMS as a viable instrument for 


€évaluation, appr@isal and development of the Coast Guard 
Meeacer corps 


10 





nc Development 


= et cee ee ae 


This stucy was done with the concurrence and ditéec- 
+ion of the Coast Guard Headquarters Evaluation Group énd 
staff (G-P-3). In compliance with minimum guidelines 2st2b- 
feshed by this group, as related through CWO S.3. 
Wehrenberg, U.S.C.G., the author developed a survey instru- 
ment. This instriment was administered py the author. Data 
ahRalysis was con¢cucted at the Naval Postgraduate School, 
Monterey, Cziifornia, computer facilities using the 
Beeatisticel Pacxkege fcr the Social Sciences (SPSS) as 
adapted for the IBM 3033 computer. when completed, duplicates 
data sunmaries were prepared and forwarded tc Coast Guard 


Headquarters, (G-P-3), Wasnaington, D.C.. 


yee ine otiidy, Concep= 


1 


From the onset of the officer performance evalua- 
mom, €Ssentially Erom the beginning of World War I, «he 
Beast Guard hes used the term "Officer Fliness Reperting" to 


Mesctribe the repcrting processes. With the implenentation of 


the Officer Perfcrmance Management System, the term was 
Changed <tc " Officer Performance Reporting ". The func*ion 
meeevaltiaticn is described in terms of serocess rather thar 


function. These subtle changes in terms address more ¢xactiy 


m@emrunc ions Of the reports and the rating cfficial 
RS 


Officers who now evaluate oth= 


a ay 


@ 


reminded by the tities 
Meat they are reporting on their performance of milit 


ary 


a 


pubs 


Mie2eS, and in sc doing, on «heir imolied ability to 


ct 


perform ruture duties. Repcrting cfficers are answering «he 
Mesic guestions cf "How did the officer do the duties 
a=esigned?", and "How carn the orficer do the dutiss 


assigned?", 





In order to answer these questions, the OPMS usés 
three forms which are applied using the techniques, 
concepts, and principles of management by objectives (MBO). 
The OPMS is ambitious in scope and length; it is the devei- 
opmental brain-child of Headquarters (G-OPES) stafi. This 


office was resvorsible for the design and implementation of 


O 


the OFMS . Further, this office and =he same individuals area 
responsible for the mcnitoring, analysis, revision, and 
final evaluation of the success ocr failure of the OPMS 
within the service. It is expected that these individuals 
would have some cegree of ownership in the ultimate success 
of tne systen. 


Thus, the results of this study may be read 
keenest interest in the office of G-P-3. Data and a 


ht 
ct Pp 


Bimeen SUurport their analysis will iend credibiiit 
a 


analyses. Conversely, data and analysis whicn do no 
a 


}-4s 
W) 
wD 


Bipeert their findings may give fr Soeccods = 200 


and analyses. 
3. Organization 


This thesis presupposes ro direct knowledge of the 
present Coast Guard Officer Performance Management Systen 
nor the Officer Fitness Reporting Svsten which it replaced. 
Likewise, it assumes that the reader will have little or no 
direct xnowldege of the history, evolu 
deveiopment which preceded the implanent 
Thererore, a historical review will fo 
The remaining chapters of the thesi 
implementation of aprraisal systems 
odology, results and analysis of the survey 
designed to assess current acceptance levels for the OPMS by 


the Coast Guard cfficer corps. 





B. BACKGROUND AND LITERATURE REVIEW 


The Coast Guard has long used a method of narrative and 
numerical evalvations for the purposes of officer personnel 
management. These reports on the fitness of an officer were 


prepared semi-annually. They formed the core of an officer's 


tr 


personal file. This file was then used to determine the 

Bietabalicy of é¢ach officer for promotion, asSignment, and 

Seroolina, Linkirg this reporting system to prometiocn and 

assignment greeztiy magnified the impact cf the evaluation 

process on the irdividual officer. 
Berors proceéding further, it 1s nec 

ee of perscnnel appraisal in the Coast Guard in a 


mesiOricet conte xt. 


estahiisrprent of a formal cr f cies aie ot ary, 
this ste ses BOrssime ne ene U.S. A Tevarve. 

i MS tae x ming cm ert OL ~S wae! ene e e cmy Ee a=VeE Cod a 

S NOcenw Ot ALY OlfrErscers 


Stem fur reporting the relative 
Ss 


rom socieéel pressures ci 


= 
L’ 
ct 
aS 
[av 
cs 
? 


Taylorism was growing 4&3 a 
Mee. lOfeziiy, ct was at this time that th 
Meese tindg and posting practices of the Ar 
Meseds of gioba® expansionism of U.S. i 
had once ceen vnosted at tne san 

i intc new regiments as 
Beructure changec [ Ref. 1]. 


feleV Or 2 = 


f-+- 


Pies wer bOrts at evaluating U.S. mia 


eh 


cers predates this system, however, tc the Continent AIRY 
in tevcluticnary times. The most widely known examples of 
early reports aré¢ those emanating from Brig. Général Lewis 


Maoo 12 1813, as related by Dilworth {Ref. 2}. 
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Pe Sec eon cs OF PA 2m) Coast Guard 


{sa 


There ar¢e few records of the former services which 
combined to form the present day entity of the services which 
suggest that any performance appraisal was conducted in tne 
eariiest years of its existence. During the revolutionary 
period through 1900, promotion in the officer ranks was 
accomplished prinsarily as a finction of seniority and other 


less specific dictums of =he voeriod. However, with the 


ad 


advent of the principies of "scientific management" and «h 
Mme=e in influence of Taviorism, ail U.S. Military Edensaza- 
tions experienceé an increased exposure tc performance 
appraisal systems. 

The U.S. Lifesaving Service was combined with the 
U.S. Revenue Marine (fcrmerlv the Revenue Cutter Servics) in 
moe DY an act of tne U.S. Cokgress which created the U.S. 
[Meast GUetd. For the flzs¢e time in the service's hi 
formal system of reccrés was created +o effect promotion 
Wathin the newly created orgaiization. 
During both World Wars, the Coast Guard operated as 


Mimmeadgunc. «O =he U.S. Navy. As such, Navy fitness reportin 


€ 
procedures, policies , e~eni forms were adovted bv the 


}4 


service. This was done essentially as an administrative 
convenience to tke Navy. Thus, much of the organizational 


v 
fegend regarding fitness cteporting, appraisal, and promotion 
Ox S 


Mer icy are dire endants of the Navy policy for that 
memi1od. Officers were pronoted soiely on a fully qualified 
basis, did not ccmpete within their pay grade for promotion, 


and were promoted only when (a) service needs allowed, and 


“3 


7 
(b) tney were fully quaiitied for the next higher gradé as 
ts { Ref. 3]. 


depicted by their file of fitness repo 
Was recognized as a 
er 


Even thovgh the Ccast Guard 
Separate military and armed uniform service in 1949, 2 long 


delay since we fcught alongside and as part of the U.S. Navy 


te 
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fiaeeall Wers Since the American Revolution,, the service 
maintained many fast Navy promotion rolicies through the 
1950's. However, with the passage of the Kerrins-Stephens 
Wegasiaticn in 1°%64, the United States Coast Guard finally 
adopted service specific officer promotion and appraisal 


System. 


ied Promotion 


a 


See fest Oua li 


The officer promoticn systén was changed te reflect 
the impacts of the Kerrins~St¢ephens legislation in 1964. A 
new rfrorm of fitness report was désiaqnsc by Mr. Joseph 
Collins and implemented by the service. Promotions were then 
made on the basis of a best qualified as desztribed by the 
new report forms. Promotion became competitive within the 
ranks as promoticn zones defined the number of officers 
Peeraible for consideration, yet permitted less than all of 
mee Zone to be promoted. Additionally, <z12 lsaislation 
required a pyramidal billet structure for the s 
miplemnen=ed the jfoiicy of ™ up or cut" *which today charac- 
terizes military careers. 

The Coast Guard Officer Ficness Peporting Systen 
Pemained stolid, with few tevisions and without najor change 
until 1 January 1982. At this poinn it was summarily 
replaced with the Officer Perfo 
(OPMS). The factcrs which caused the change are subject to 
debate. The Coast Guard Of fi 


Ormance Management System 


cer Fitness Reporting Systen 


May have been outmoded, inflated, unwisidy, not psyvchometri- 


Marly Scund, or rot liked from its inception «o its demise. 
These tractors may have led tc efforts +o upgrades the sys 
eyer ti The putlishing and subsequert adoption of the 


y 


° 
SUEDELINES of the 1978 Equal Employment Opportunity 
Commission by tne federal bureaucracy may w 2 


this process. 
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4G. Dynamics f 


These changes in the rules for perfcrmance aporaisal 


were amcng many that led then Commandant of the Coast Guard, 


aU 


Admiral John B. Hayes, to direct the establishment of 


staff element to study the system and provide reccommend 


ra 


a 
i 


enange for the future. This led to the contracting o 


om 
bc 
ct 
iD 
i 
6) ES = ps 
tk 


General Research Corpceration, McClean, Va., @sS an 


j.4 
a) 
on 
iD 
i 


research agency +o assist in the development of a 


‘| 
fe) 
‘Cs 


mént for the then current Officer Fitness Reporting 
Mae Gre effort began in March of 1980. 


if) 
bet 
r* 
ip 
= 
ry 


Coast Guerd Commander Nicholas H. Allen ana 
Bradford P. Sharr headed this research sfrort for the Coast 
Pueea:; Mr. Daniel J. Tobin, Dennis G Faust, Ph. B., and 
Robin Levely were key researchers for GRC [Ref. 4: ch.1]. 


C. GENERAL RESEARCH CORPORATION 


The General Research Corporation, Final 


R 

Coast Guard, March 1981, was issued three months snoseacuent 
Peomihe decision to implement the OPMS. The re 

Specific conclusions relevant to the developme 

type cfficer performance appraisal system and the 


Organizational ccntext and environment to be encoun: 


ct 
yh 
MH 
@m 
fs 
SB 
het 


that system. The cenclusions are pertinen 


re, 
Ne 


rh 


the art at that time, the 2ffectivensss o 


Pao eee iis oh 
we Ye wey Puy a Le 2 ae. ws iy 


rey 


nad the iong tern effectiveness cf any performance appraisal 


orem adopted by the service for the cfficer ccrps. 


1. General Fesearch Corpcration Final Report 


=—= = ee ee = — =e at 


The repcrt or the GRC to the Coast Guard identified clearly 
that there were dysfunctions in the fitness repo Rg 

process. Additicnally, General Research Corporaticn recon- 
ended specific clanges t~o the process of officer personnel 


Management in the Ccast Guard . General Research Corporation 
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Best the =Ssnoe of its analysis within the framework of the 
Peete zarioral Gentexteor the Coast Guard. This final report 
to the service cites several perceptions which will impact 
on general systems effectiveness of any perrromance 
appraisal efforts directed at the Coast Guard officer corps 


in general [Ref. 4:ch.4-6, ]. 
2. GRC System Conclusions 


The study groups conclusions are listed below: 


Police clr=oel= Syocom mas been adequate in che past 
and possesses varying degrees of loyaity and accep- 
mance £tLOom the leadership, cfiics > corps, and systen 


WSels. 


Zetia Clzae tt fitness ropocting System does _not take 
pvearage Ob Stace-O- the-art advances, nor does it 
meez the sugcested design features of the Uniforn 
Guidelines (fFEOC GUIDELINES 1978). 


PnemciLLe LT a VSten, whole at p=esent adequate to 
ie promOclOr and assitgmment Eunction, lacks discip- 
line and is cn a rapid-obseience course. 


Jee secause the cirrent Svstem is essentially an even* 
@aerepted ratkrer than 2 process-oriented system, it 3 
Heegequace if terms of imprcving periormarce throug 
effective counseling and is vagus in its relaziozship 


ad 


tc actual performance requirements and standards. 


oe] Gurrerr system 15 Razeow i 2tsS crientation in 
that it assicns @ single powerful role to the 
feeereahg Obi Ccrs ©O Che detriment of the soles that 
otner members of the avaluation chain should be 
playing. 

Seethers is ttle or no training in regard to evaiua- 
tet <«rainanc and responsibilities in the current 
system 

eeene COa&= Glia=a OfLicer corps is beccming progres- 
Sively more gualitied. 


. 


Be The fitness Beer eet System for the 1980's will be 
under greater scrutiny Bbotn_ internally and externally. 
Mme, crore, 2% 1S isncreasin ty jikely that the system 
will be required to show that it adequately pertorms 
mes 2nhvemded £unccions end conforms to the Uniforn 
Guidelines. 


V7 





Officer Fitness Feproting System, GRC is 


Geeine fitness reporting system for the 1980's musx= be 
an open, " akove poard system prepared to meet the 
Challenges ard achieve the support and confidence of 
mene GlLElLCer COrpSs. 


10. The fitness reporting system for the 1980's needs 
+o bketter accomodate the performance improvement func- 
tion and better assist the organization in the 
Management of its work effort. 


ie eiemaucnessmmuepeortingewsysten for the 1980's should 
be expanded from an event-orientéed system to a nore 
dynamic perficrmance cycle orientation. 


12. The above may require more pe=rormance appraisal 
training for all Coast Guard officers. 


3. GRC System Recommendation 


tt 


mOoliOWamCc The =tlcld testing of a prokotype form and 
associated process intended to replace the then current 
S 


ued the rollowing 


© 
recommencations to the Headquarters Stafit and Study Group 
(Ref. UYsch.4]. 


In general it is recommended hat : 

Bae Sevissone toe the existing system follow the forms 
and procedures ued in the prototype evaluaticn. 
Recegnizing the limitations of the fieid research 

eee vey, coer alll policies, procedures, and forms be 
Mmeveuatced Gf a Major Operational field test prior to 
smplementaticn. 


A comprehensive set,of separate ins<ructions be devel- 
Oped tO SUppCcr= orficer fitness reporting. These 
mmeceuctions be contained 18 @ separate nanual rather 
than in chapter form in the Personnel Manual. These 
POS=Luctiors should contain a performancestandards 

Gee sor Jf Signiticant data aze 2vailable from tne 
Ceas= Guard job task analysis project. 


O 


formance apparaisal be 
Were one COast 
e, quantity, and 
Go (ei ees 

aE OD WeCri ve OLgene 


Beocrorg training program in per 
developéd and institutilonaiized 
Silerd. Determination of the t 
desired level of ay ee: Se: 
BePpCLTctcing requirements should 
Operational field test. 


A comprehensive information pro 
the officer corps explaining th 
Of the fitness reporting sySten 


m ba deveioped for 
need for and vurposes 
evisions. 
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A cemprehensive system for monitoring the plan be 
geve, Oped. It 2S not expected that any performance 
appraisal system will remain etfective if not continu- 
Biy TOns. tOned. 


D. CGAST GUARD TRANSITION TO OPMS 


1. OPMS, MBC, and Army 


lO 


ER 


“he development of the Coast Guard OPMS is not a 
direct result: of the General Research Corporation findings. 
Forms, procedures, and policies were revised to reflect scene 

£ the recommendations of these externai consultants. 
Additionally, the internal study group established a verfor- 
Mance apppraisal system which also included internal design 
paremeters not necessarily knewn to General Research 
Corperaticn. The result is a system that incorporates not 
Sm y features of the GRC prototyne, but also contains many 
Meeeai te! forms, EOlicies, and procedures of the J.S. Army's 
Officer Evaluaticn Reporczing System which was finalized in 
Meo fRef. Sj. The close resemblance cf the Coast Guard 
rormS and processes to the U.S. AEmMy System may stem from 
GRC's close association with the development of the Army 
program. It remains to be seen whether the twe systems will 
bear cicse resemtlence in the Future. 
© dascribe the two systems 2s pa 

priate. The majer differences, perhaps «he on 
in the systems are the inclusion of behav a O 
rating scales (BARS) by the Coast Guard and the semi-annua 

Gemenmiual COcSc Guard TEpeorting requirements. Alchough 
mes 2S a rather giobal comparison of *he two systems, it 
adequate for the purpose of this study. Both systems are 
essentially MBO, process-oriented officer perfcrmance 
Management systems. Both systems use an appraisal supvort 

+ 


meet and a performance reproet form. The int 


ls, 





purposes and end uses of each system ars the same. This 
ccmparison has peen drawn to enable future researchers to 


utilize the similarities to combine data bases as may be 


appropriate. 
2. Overview Qh OPMS 
essentially, oO 


PMS is composed of a cyclic appraisal 
and evaluation process which is guided by the mandatory 
compilation of deta and jouzcnal type log keeping. AS a 
system which includes goal and objective setting as a 
process for developmnéet of individual potential and the 
integration of personal and organizational goais, the Coast 
Guard Officer Performance Management System is @ classical 


application of Drucker'’s management by objectives [Ref. 6]. 


q 


The purpcses of the OPMS are threefold as described 
mye S. CO 
° 


Swcoteunmins sue t.Ons fRet, 7]. Appropriate 
sections X 


Ste see TOrth below. 


errormance 
ee main purposes in 


ct tg 
or pic 
Posh 
ck fd 


credible information necesséery, 
ehagement dscis -ons primariiy in 
faeanG sto a Certain Cxecnt, 


ih irOe 


(oh 4 
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regurienent 
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Fnhances crganizational effectiveness by 4 means of 
ucture for mere clearly assigning responsibilities 
qd gqefining relationshipS between peopl¢ and tasks 
hoateene Chawn Of Command . 


ZVAW WORD A chthoa 
Mth « 
Hi ttQ. 
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4. OPMS Principles 


D 


The Officer Psrformance 


ated under the fcilcwin 


IreOEMS 25 aio sneegqrai part of 
hion.<. 

PeeOrPMSs) 2S CChtLIUuoOUS.. 

3. OPMS measures correct and rele 


performance. .. 


Heeoets laine ts Subject: vity... 
OTIS = S CCNSctCUcCtTLVe... 
per OEMS EOSters Consistency... 


These principles, simply stated, 


Management. 


principles of design 


managing 


the organiza- 


Pane AimMens= ons Of 


1Orm the basis GF 


extensive organizaticnal policy concerning the uses, appli- 
Cations and executicn of the data generated for the OPMS. A 
More detailed review of these princivles :.¢ available in the 
Coast Guard Instructicns which implemanted and govern OPMS 
{Ref. 7]. 
5- Roles, Ernctions, Forms, and Process 

NeGduaormdweny jane i mblenentane Gns:=uctions estab- 
lished reles and functions of officer within the governance 
@emctie OPMS. These inciude defined rteles of 

Commanding Officer 

Reported on Officer 


Commandant (G-PO) 
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PacwmOEmNe Gores adentified has specifically 
enumerated tasks and responsibilities. The authority defined 
by the instructicns are essentially top down. It is of 
Mmaterest, however, thet the responsibilities for reporting 
ee at least iritially, from the bottom up. It is *he duty 
of the Reported cn Officer (ROO) to initiate reports, seek 
assistance, and Gevelop his performance. [{Ref. 7}. 

There aré three forms integral to the OpHs. 
Generaliy, these forms are used to document perrormance, 

Get 


reported on officer (ROO). These forms ar2 derin 


+ 


th 
a) 


report perfcrmance and assess Future potent: 


- 


- 


(f) 
(a 
sal 


5 


follows: 
Officer Perfcrmarce Support Form (OSF). The form used 
ZO aSSist thé delineation of duty tasks, and the | 
emiencement cf Orgenizational communications, vertor- 
mance ccunseljing, and performance reporting. 
Ofiicer Pericemance Report (OPR). The revor, usei bi 
ewemcO =SpOrveOn ithe PSrreoEMance and potsntiali of an 
OrrEicer. 
Bretce: Peet cenance Revorr Cont -nualior Form. as 
TOrM USead TO present additional comments and evalua- 
moms that ¢O NCt £2t in the space allctted on the 


OER 2 


oie cht. culation Of roles, forms, and time tIrames 
mee prcvided in the form of a Elow chart in the Commancdant's 
Meeruct Ons. At the risk of oversimnviification, it is 
enough *o state that the OSF is the central document of the 
MBO process. Supervisors and reporzea cn officers deve 
this document at the onset cf any reporting period (seni- 
mialiy) and certer a dialcque on its con* 
4S pericdically teviewed and revised during the reporting 
period. At the completion cf the period, + 


in suppert of developing the OPR. The OPR is forwarded via 


a2 





may be used in the basic functions of promoticn, as 


ih 
}- 
(Cy 
a | 
r3 
D 
<3 
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and seiecticn for training cr special assignments. It ig a 
powerful document. [Ref. 7 }. 

Me loan tncen. Cf she OrMS, however, that vrcocess 
of developing these forms be stressed more than the inmpect 
of the forms therselves. The goal-setting, feedback, and 
counseling features--essentially the people process MBO 
functions of the Officer Performance Management Systen-- are 
@mac GlStinguish it from the Officer Fitness Reporting 


System it replaced. 


ce OUMMARY 


messeconcludes the intreductory section of this study. 
The reader should now be Ome oe Pe we :voeinN.O) DEOad 
industry issues cf désign and iaplenentation in the 
Moe lowing chapter. From this os mie. ade hor wid 
an awareness of cesign criteria, an evaluation process, and 
the resuits of a survey developed and administered 


attempt to fulfill the evaluation ae ibe icles aer 





II. PERFORMANCE APPRAISAL DESIGN AND IMPLEMENTATION 


A. INTRODUCTION 


nm Many times...I have come to realize 
that a fervent speech, or a painstakingly 
well written document, mav_ be worth no 
fez ec wenan the good Will ard patient coop- 
eration of these who say they subscribe 
om coe Vre  NUlta vil caron Of dOCUMENTS, 
BoSsOmutsons, cxnOrea t2ons, and declame- 
Bemvecta.elelcs Secs co be the major 
growth business of the age. I fear we 00 
often lay more stress words than on the 
stark necessity or deeds to back them 
U ee 6 

Deen SCN ROWE 


maceenwords from DoDe Eisenhower succinctly point 


out 


‘W 
the major nurdie enccunctered by those who would make policy 


today {Ref. 8]. It may be all too simple to voice su 


pooert 


Sua policy and concuurently vow silentiv to let it wither 


Seethe Vine rather than oppose that policy in vublic. 


Mamrewise, even ttose who truly support policy are oft 


zn hard 


meee d c£c LroanSicrm their intents into consistent action in 


BeereOr. CL that policy. Thus, 1% is vitai at the outs 


an endeavor,such as changin 


ve) 


Vv 

personnel policy, 
Eesure that the rolicy is wel Or 
and readily suppcrtable by th az2on for «which 


designed. : 
B. STEFEING STOKES IN PA DESIGN 
1. g¥amine she Givens 
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~ 7 
4 ome 


imwees i2keliy thac that feyyo ions are 
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Besition of desicning a formal 


sey) 
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pore 1 systen for = 
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mest time. Mo 
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DiKciv,  OnGetigac! ons Ar 


n 
existing system to meet changing times, rew personnel 
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ted, well understood, 
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apt to revise an 





changed work specifications. How prevaient these revisions 
can be was reveeled in a study of major corporations. 
Teel's results irdicate that the overwhelming majority of 
systems are modified every three to five years. 
Additionally, his study indicates that minor revision and 
evolutionary charge is more prevalent than major, revolu- 
tionary change in this area [Ref. 21]. 

Thus, before an organization launches a major effort 
to redesign an oferating PA system, it is important to 
examine what is elredy in place, ie:- tc examine the givens. 
Some leading questicns put forth by DeVries (et al) are: 

1. What problems or issues have created the need for 
redesign? 

2 What existing organizational committment is there 
for redesign? 

3. What can realistically be done during @ specified 
22me Period ? 

Peat SESOULCeES @xi1St =c car=zy out the work? 

Ds How important 1s 1% to design or tevise the formal 
rA SYSTEM: 

ieee setaeniy 8@ikely thas the process of PA design 
and tevisicn is rever ending, a Sysisphean task.iven thoss 
Systems that are working well today wili undoubtly require 
Change in the future, near or Gistant, as the factors which 
determine the jokrs evaiuated will undoubtedly change. Thus 
Bepls necessary to ask and re-ask the fcregcing, even at a 
time when the design or revision has just been implemented. 

2. Choosing the Deveiopmen® Group 
Currently, industry trends indicate that many PA 


systems are desicned Ly the company's corporate-level 


personnei department. 


* 6 . 
PeaLlcates 


A 1977 study by Lazer and Wikstron 


approximately 73-75% of new PA systems grow fron 
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corporaté staffs, abcut 7-15% grow from division-level 
mpagetbe, ena inteSinal or external consultants account for tne 
remainder. 

There are three general groups who could participate 
in the design stege namely, (1) cutside counsultants, (2) 
inside consultants or change agents, and (3) line managers 
and employees. ‘There are advantages and disadvantaqes in 
G@-recting «hat ary cne of these groups conduct the design of 
a system without external influence. 

Outside consultarts who are specialists in PA wiil 
Meceiy neve the technical expertise to provide a psychone- 
tricelily sound Pa system. Hewever, their lack of inside 
knowledge will limit thelr awareness of the nuances of 
Meare izac2onal ccatext,’ dmd thus, will limit their ability 
tc intergrate the PA system with preexisting crganiza 
Pye-ems. Additioraliv, the ccst of theiz services neces- 
meme y Gi2ctates that the associeticn of an organization with 


h 
[em~e=> hal agen=s 31S ox they short tezm. This factor nay 
fe) 


+ 
'. 
;—+ 
U) 


Met Int evOocegecads ly Obvious +0 ch 


iD 


induce many shorti 
Surscry cbsérvecr. 
Cn tne other hand, internal a 
1StS may have great insight to the st 
Meeecat2nq conte#t of thelr organiati 
may be limited bv a paucity or indepth, sta 
Maowleage of current FA technology. Additionalil 
change agents may Gtten find themselv 
structure necessary =o effect legitimate c 
Meee tack credibility within their own org Z 
because they are part of that organization and 
Qutsiders! Finally, the authority of internal 
iS SOmetimnes limited by internal organizational po 
In contrast to either of the foregoing croups is 
final group, line managers and employees. Whereas this a 


may be lacking téchnical expertise with the nyriad 
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innerworkings of a PA system, they do have the most expert 

knowledge of the day to day uses of work at hand and tae 

evaluation systema in place. They ace in @ unique position to 
n 


accurate input concerning the 


ni 
j— 
t 4 
( 

¢ 
aie 
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provide the most re 


a 
nature of the work, performance cri’ and useable 
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appraisai methods. 
Ber A Combinetion of Talents 


The raticnal approach in resolving the issue of who 


Can provide the test infcrmation i 


\ 


design aanéw system is 
to include elements of each of the For¢ementioned groups at 
je Outse. of the design process. Each croup is able to to 
Mere Unique contributions tc the precess. Fanally, it is 
Criticai that this design group be representative of tne 
major segments of the organization and tave the crediblin-} 
and authcrity necessay to win the acceptance of their design 
by top management as well as lower echeicn members of «ne 


organization [R Ole 


otgarizational context inte which PA systens 
must be inteqrated te be ef fective have recently been 

fRer. 24], and Wexley [Ref. 12], 
descrioe factors which must be synthes:zed when imple- 


addressed. Kane and Lawl 


o 


menting new systéms into an environnent. That a PA systen 
must interface with many sys aireadvy in place as weil as 
future changes tc tnese systems is a Foreqgone conclusion. 
Menmy fLectors resultant from these areas of interplay must be 
acknowledged, accounted for and deai*+ with. Failure <o 
recegrize and ad¢ress these factors Erom the design stace 


can severely linit the success of any PA progran. 


Par | 





5. Consistercy w 


Ti ie 


En Manheqenenc P 


performarce appraisal programs do not exist in 2 
VOld. Rather, they tend to be central to many related nanag- 


= 
€rial functicns. Generally, they are existant in the niddle 


of highly structured, hierarchical organizationai. preocessés. 

Mee such hierarchical organizations, it is likely that 

responsibility fer strategic decisions belongs to the 

senior management. Likewise, performance appraisal functions 
mp ilove 


generaily belong to the senior member of a manégqer-e 
meee fReft. 10]. Tais is cartainly so in military cr 
Pons. in the Cozst Guard context, many es, have 
been produced to assure tnat the appraiser is senior to the 
appraisee in the past. Thus any Rew apvoraisal system nust 
See tts Organizational proclivity znto accoun: from zhe 
design stage . Failure to de so might be t0 invite added 
resistarce to an unneeded change. 

WaenrOnrgehazat Ons Wich @ Scrong hierarchical <struc- 
Oise, cycified by the military, enter into PA programs 
invoiving mutuai goal setting, sharing, and two-way conmuni- 
MeezOn, dysfunctional behavior can be a result. The factor 
M=soensible for the dysfunction is the incon 
the PA rcoles (of openness, sharing, and mutuel ee eh c Of 
strategic geals) and the general operating 
mollOwing orders. 


The degree of democracy, delegaticn,and 
c P 


mop iscitiy required in effective particpative PA proaches 
may render a performance appraisal sys*eéem meaningless in a 
etaditionally strong, top-dewn organization such as nilitary 
Bat (Ref. 10:p. 99}. 


Mic ~ehetoeCcriuical at the sutset of PA design to 
ensuze tnat the design is consistent with management philo- 
SOphy anc practice 
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Mangerial Work 


6. Conflict with the Nature o 


It; 
jo 


Peaeres 'yetaougberg Ref. 13], McCall [ Ref. 14], 
and Bennis [Ref. 15], to observe and characterize the nature 
of managerial work have been enlightening. These sti 
reveel that the manager's jcb mcst often consists 
varied, fragmented activities. Additionally, it has been 
shown that managérs prefer to deal with current issues and 
non-routine tasks. Mintzberg's study went on *o chazac- 
terize most of managers’ action as ad hoc, reactionary 
rather than planned. 

Performance appraisai, on the other hand, requires 4 
process characterized by relatively long, inténse, and 
Mencernita~ed activity focusing on past performance. The 
Memeratl format fcr PA tends to be one cf high structure and 
periodic routine. Appraisal frequently tTegquires planned, 
formal interacticns Lrétwéeen manager and employee in which 
Beieerrupctions are not allowed. 

This is certainly the case with appraisai techniques 

ithin the Coast Guard. Policy makers have continually 
Bemessed that gocd i¢caders counsel in private. Legal actions 
have required formality to grew to immense proportions when 


negative behaviors are denoted.Reports of Fitness of oaffi- 


cers for general and specific duties are closely held, not 

revealed, and sukject to great censure if misdistributed. 
Therefore, it becomes more cbvious that desiaqnerzs 

Must be Sensitive to the nature of managerial work when 


designing an appraisal system . Failure to acccunt for «the 


nature cf the beast may place whe system in direct conflict 


@ith the very pecple most needed to make it work. 
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7. Compiiance with Legal Recuireaments 


Federal regulations regarding ¢quéai enploymenc 
opportunity, adverse impact, and equity have grown with the 
adoption of the 1978 Equéi Employment Opportunity Commission 
Guidelines [Ref. 16]. Additionally, employee litigation has 
increasingly enjcined management in suit to assure fairness 
in appraisal. During the next decades, regulation of 
appraisal functicns is most likely to increase rather than 


decrease. 


8. Aéninistraticn cf Performance Appraisal 


aS ee Se ae Oe SS eae SS 


The source cf policy and procedure regarding verfor- 
Mance appraisal ere important cues +9 its crganzational 
impact. There are severai echeions where theses may 
emenate-for examfle, from central corpcrats headquarters, 
mecional offices, cr local line preva tens: Each source may 
Peal itrering impact cr the appraisal system. Not only do 
directives carry different connotations dependent upon their 
source, but they may imply totaly different positions of 


Mewer ala authority. Thus,the efficacy of policy may be 


ct 
by 
iD 


dependent uwron the pclitical or bureaucratic position of 
Mece Of the policy. This point is best 4d 
Mmmmerson’s analysis of the "Cuban Missiles Ctisis" [Ref. 17}. 
Additionally, the uses of perfornance appraisal vary 
meom Orfice to office, level *o corporace lev 
example, a line manager may use appraisal toe Encourage, 
Teward, or dismiss an employee. Performance appraisal in she 
field may weil be aimed at growth and deveiopment of «he 
employee. At the corporate level, however, performance 
appraisai may take on the appearance of being soley an 


Pemonastrative func*ion. 
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Performance appraisal systems with employee growth 
and development as their objective are best operated fron 
Besrticns close <Oo Operating units, tather than frem corpo- 
rete headquarters. The primary concern with administrative 
functions of appraisal tends to overshadow the developmental 
function of systems housed in a centrai corporate 
headquerters [Ref. JOP ral 6] . 

mls, = sto crltcaca! that d@szqners plan for this 
pias when designing and implementing appraisal systems which 
ncminalliy cencerr themselves with growth and cevelopment of 


mY 


che employees. 


9. Integration with other Human Resource Programs 


Appraisal is often a stated basis, cr core, of én 
Gzganization's human resource development program. Often 
cther proqrams sucn as pay, advancement, retention, and 
training opportunities are keyed to an appraisal system, at 
Least on paper. 

In reality, however, managers are often unabie to 
use PA as the basis fer tawards or punishments, due a lack 
of, Or overabundance of, rewards. At times there may be far 


meq few ~ewards for anyone to share. Conv Vy = 
Growth and expansion, evervbody shares the wealtn regardless 
cx personal merit. 

Even in corpcrations that émphasize merit- 


MectemS, appraisei is often net integratsd as a sy 


i 
decermine nérit. Though on paper che system might 
Bee Lunctional link to merit pay in 
subverted =o mest otner needs of manadqe 


fess 


reveals that many managers have forced appraisal cr 
zit Salary decisions in an effort to vrovide 


memeene JOD conflic<. 
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Contrastingly, some orgranizations tr other 


on, and 


a 


eat 
human reseurce programs (such aS saiary, promcti 
Pebecticn procragys, as totally separate from the apprazi 


Beocess. This is certainly to in the Coast Guard where 


Sir2cers are admcecnished that " it is not your duty to det 


j—4 


= 


{ 


is 


Mine promotability when evaluating an officer's pezrficrmance" 


= 


and where pay decisions are left largely to Congress and the 


Secretary ot the Department of Transportation. Thus, an 


appraisal system may appear as a redundancy in organizati 


wherein the basic functions of appraisal are usurped by 
otaer systems. 
DeVries FRef. 10spe 1071], warns "th 


Gee = TaueraA 
program is redundant with another human resour 


c 
MieiesS “iming restricts its usefulnesss for cther personnel 


decisions it wiil be treated superficially or forced into 


Mia ppECEriate uses to preserve other prograns". 


@ progzan, 


ns 
od Ow 


Or 


10. Top Hanegement Supoore 
fichael Eser [Ref. 18] cites lack cf top management 
Mepeport aS G@ Criw~ical factor that is cited for many inci- 
@ences of failure with appraisal systems. "Top Management" 


Mena taitly icos¢ term. In an effort to more closely ider- 
Seeeyo What iS meant , DeVries [ReEF. 10:p.. 102], lists the 


Mem@lew2ng Lactor€e to clarify what this construct infers: 


eee eee O Pace Nagios CeSsponsibi lity fo® PA imp 
Mentation wa¢re the program can be effectively carr 
Sout. 

Peeaa Ure tO allocate the resources necessary +0 
effectiveiy implemenz= PA (money, tine, Sea 

Pec arlure tc consider how PA mus fit with other 
human resourc2 programs. 

Meraltliuce t¢ 2dentiry a clear, 2fganizataonal policy 
Bers Stent With cpereting management philosophy. 
Seefaltlirs tc includ= effective anvpraisal practices 
as ore criterion in tae managerial Teward structure. 





CrvCLy Mote 2Ca Pa procedures to and 
=Cxs Of EEOC compliance. 


MimcdimeenonaoiesAGtOL, GCileen Snumerated, is th 


1) 


failure tc provice a credibie, visible spcnsor for perfor- 
Mance appraisal. Far too often, top executives espcuse the 
importance cf performance apparaisal for others and disre- 
gard it themselves. 


C. DESIGN SUMMARY 


Planners, designers, and architects of human nature as 
well as physical constructions realize that any major 
constructive effcrt will stand oniy so well as its base will 
SmeepOor. i=, Thus, it is vitai that the initial analysis and 
design be Systematic, global, and aimed at reducing syste 


m 
generated hazards that wouird impact on the users. It would 
) 


h 


be best if everycne were 20 gain from the implementation 


i] 


t 


@ new appraisal system; as Minimum, cne would assume that 
the design would ensure that ne ene would be worse off asa 


met €6COmflChUvthh AS 6UCEVeNnt. 


Meee SLEPPING STORES TO EFFECTIVE IMPLEMENTATION 


mmplementaticn is <he criticel stage 
the hard work anc handiwcerkx of the design stage into an 
effective cperating system that accomplishes 
Mee Within the limits cof the criteria este@b 
design concepts. This system must usual D 
imto a complex maze cf value systems and organizational 
procedures that can be cverwhelming. 

fees task USvaily falls to the internal consultant or 
SiesOLganization's personnel staff. Nystrom [Ref. 191, 
depicts scme proktlems associated with this manuever. 


BeecOnne: staffs, thcugh often in the best organizational or 
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administrative seat for implementing such a program, nay 


have a reputation of such narrow focus or linited success 
Within the organizaticn so as to lack the reguisite credi- 
bility tc effectively implement a néw appraisal systen. 
Down-the-line emrloyees are often skeptical of the motives 
of internal staff members who nay have a large stake in, or 
Mieh £O gain from, an organizetionai change cf this nature. 
Tt is not important whether this skepticsin stem from fact 
Menexperience. However, it is vital tc recognize fas 
Sammon perceptl.or and concurrent distrust as a factor which 


May weaken even the best planned implementation efficrt. 
Additionally, new programs even when Highly polished ard 
far removed from internal politics, are orten yiewed a 
Simply " ancther personnel program " . To avoid this 
jaundice, as it were, top management may be well advised to 
Scrutinize who, exactly, is leading the effcrt of inplemen- 
Memon. By the judicious use of members hichly respected for 
their ieadership qualities and credibility, top management 
Megat avoid limiting the stfectiveness of a new avopraisal 
meegtem FLOM LiS point of inception. Conversely, tcf manage- 
Meno may only blzeme itseif if ite 
Poeen- UpCcn impisngentation, only to find they have srent a 
ieee Of time and eficrt cn an appra: h 
impact énd effectiveness because it is oerceiveid as " just 


Biorner personnel pregram " (Ref. 19). 


fe, Llaining Programs 


training necessary when inplen 


(D 
a 
ct 
t> 
~ 
\Q 


a 
program. One guiceline might? be to measu O 

hewness " in the program, or to asses the amount of change 
or effectiveness which the design interds to accomp £ 
the change to the new system. One might conclude th 


meme direct, lin¢ai relationship involved. Yet, two rec 
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Survey efforts still reflect a difference of opinion on «he 
Meed for training. Lazer and Wikstrom [Ref. 20], depict 
Mac about 75% of industry conducts some type of training 
upon implementation. However, Locher and Teel's resuit 
Poeent to only abcut a 25% incidence of training concurrent 
with new systems [Ref. 9}. 

Regardless of what the incidence or extent of 


Bpitial training effcrts may be, these initial efforts are 


Mis. that, initial. There is no guarantee that persornei , 
KnOWing what is required of them, will be either able or 
Mommienng <O provice it. This is the function of training, 
education, and system discipline. Although appraisal skills 
required are a functionof the type of system in use, two 


widely accepted skili-sets are (a) performance measuement or 


meting SKkKiiis, and (b) resdback or communication ¢ekililis. A 
system based on the principles of management by objectives 
would also require hign competency in goal setting process 


{ Ref. 10 Je 
How thes¢ skills are best acauired is subject to 
debate. Azqyris weuld assert tnat these skills are lsarne4 
by doing [Ref. 2Z]. Recent studies done separately by 
Myancevich {[Ref. 23], and Latham [Ref. 24], indic h 
these skilis(performance measurement and communicaticn 
n 


Sebel s) are best acquired through practical train: 


: 
Q 
jv 
re 
CQo 


experience as is often available in a school or laboratorv 
Seeiaet2On. Additionally, ratSrz training has been shown to 
reduce psychometric errors by raters. This was det 
meemoski [Ref. 25] in a study of of rater errors 
in 1974. I+ should be noted that the ¢ffec 
feezning is short lived. Thus, ae refre 


is necessary. 


. 


tnally, tnere is evidence to suggest that emplcysees 
Boemeeoenertit from tramning pxrcgrams which depict how to 


- 


receive performance appraisal, especially in participative 


Shs 





programs such as MBO-based appraisal systems. Four issues 
seem relevant in this regard. First,th¢se programs permit 
employees to participate more actively in their own PA than 
they did without them. Second, these programs provide for a 
cadre of monitors who may well be willing and able to main- 
tain the integrity cf the system cver a longer time period 
lena wichout this training. Thirdly, this same cadre often 
may advance to the managament levei and be cr become 
appraisers themselves. Lastiy, most personnel who giv? 
appraisais ~o others also receive them themselves; thus, the 
training pregram may certainly flow full circle and have 


wide application . 


MesnoulGgweche sat2Oonale Cr providing training seems 
M@evaous, this treining is often not accomplished by organi- 
Zations implementing new apfraisal systems. This fact nay be 
@amain factor in the failing by many systems to meet *heir 
stated perficrmance appraisal goals. An exceilent exénmvle of 


« 


ei 
mors poin~ is previded by Beer [Ref. 18], wher2 he relates 
m ét the Corning 


nis experierce at implementing an MBO progra 
Glass Works in 1S$77. 


ore buying a new car, most of us will take the 
meme <tO Crive it first. The same logic that guides us in 
personal exp ures should also be appiied to the ex 
ture of great resource (time, effort, and money) in our 
professional lives. A performance appraisal system must be 
tested before it is placed into the organization who must 
Erom that day forth " ride ™" on it. The new system can be 
= 


~ 


Validated, modified, and standard: in a testing sizuation 


ieee oe cor taney a: this poi 


ize 

before it is given the broadest inplementation. 
Me OQ O8f for Success. 
se 


Choose a test bed that is (a) representative of the whole 


Meee azaction, and ({b) likely to have a successful test 
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experience.If the event is successful, then those who urde¢r- 
went the experierce can form a cadre of misSionaries who can 
advocate the use of the system from their own experiences. 
Since this group may well become advocates, it is criticai 
+o analyze who they are before you test the system on them. 
Likewise, it is recessary to design a system test, OF proto- 
mype, that is highly likely to be successful with this 
moo up. 

ror examrle, if the group is perceived as deviants 
qyithin the crganization, the appraisal system may be 
severelv cripplec by their association with it. Conversely, 
if the test group is composed of credible, powerful figures 
in the organization and they become advocates, well, czhen 
this is a very satisfactory situation. 

ma Nel itary Ordanizas.oOn, this latter group is 


Known as the top management, the le 


j~ 
KS 


usual 
Makers, Ot the Ssénior orficers. They ha CHeObaty =¢ 


Vv 
meoc Of D=eex any policy or procedure. It i fee OS ave 


b] 


a 
mM the begin- 
a 


~s from the +op down, not vice-versa. 
3. Maintenarce Functigns Necessary for Successful PA 


Many new programs have not survived due mainly to 
Meee Of nurture following implementation. Interventions when 
necessary, are most successful when the strategist cbhserves 
some crgoing continuum for change. A simple modei for change 
Mmee-one Kolb-Frohnan model fcr intervention [{Ref. 26]. 
Bssentiaelly, this calls for an ongoing str ge for change 
which dces not end at implementation. Likewise, implenenta- 
tion of a new performance appraisal system should rot end at 
Seyeone, but rather continue throughout the li Of nat 


Byocem Within the organization. 
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Maintenarce functions which continually encourage 
the use cf +he syetm may spell the difference between 
success and failure. The organization must provide a reward 
structure that encot.rages managers to use the system in the 
fashion desigqned [Ref. 27]. Additional functions that may 
keep the svetm reclling on the paths to effectiveness include 
reminder services, ccntinued training and consultation with 
human resource professionals, and actions by top management 
in consonance with tne system principles speli the minimum 


level of support requisite for success. 


Se tey ta Sess2: 


The obiective evaiuation of system effectiveness is 
often the nost onmitted stage of the implementation process. 


Me 2S a Criticai issue, knowing that the system is func- 


*29ning as inzended and acconplishing the tasks required, 
Mee 2t 3S not accomplished in mény instances. Reasons for 


212 


vt 
value in knowing whether the system is functioning properly 
ii 


#9) 
js 
\-! 
ct 


is are varied. Of%en, it is easy t> assume there i 


peel. Cah be limakea directiy with preduction or profic. 
fee nos Wiemare f=Ss porns: ble ror diztectiy advocating 
menting @ naw system may blicck objectives analvsis 
ultent of Dae peztsonal impaczs that the analysis 
Vv 


c7 
Rae he 


€. svaiuaticn of verformanc? eppraisai s 


< 


Neca 


‘D 


ed be ope tentures at least 
As a continuation of the stepping stone approach so 
ented, the following questions are posed as appro- 


priate probes for the evaluation precess. 


- Was the system instailed as designed? 


1 
2. Are the employees using the system as it was 
designed to ke wsed? 
3 
b 


~ Are the systems intended purposes and outcomes 
eing accomplished? 
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4. Dees the jeré crmancs appraisal system fit within. 
MNieCmMOE CCM Ze vOue  COn l= <n, Darzicularly in terms of 
other human iescurce pr ogra ns? 


There are various types of changes which can be 
instituted along the way. Essentially, sach negative answer 
to the preceding questions would lead back to the design and 
implementation stages. A simplistic management control 


2 


system that asks these questions does not néed to meet «he 


Parametric requirements of classical research, rather it 


need only ccliect data relevant to the intended tasks and 


design or the system. 


Ew CONCLUSION 


1. This discussicn may have painted a monstruous spectre 
Bee, cCerfcrmance eppraisai, rot uniike that of a sm 


m 
= sea, caught in an ocean storm, expending its total enerav 


9) 


MemsaMpiy keerinc aficat, with ne pr 


Os 
the shore. Yet the effor= nust clearly be made; apprais 


ystems to manage the information *khus 
compiied must be used. 

Despite the controversey, two guidelines may appear 
Merth (Tcilowing. First, nertcirmance appraisal must be 


understandable tc these who use it, regardless of type, 


t 


{+e 


Semaent, prcecedure or purpose. Tf wif nO, Cleasly er 7icu- 
m hoids no chance of 


Derng effective sithin tha co 


5 

lated and understood, «hén the syst 
x Pee eSOLi Gated. pus Doce. 
m 


a 
Secondiy, performance appraisal St make sense in relation 
*c othe= business systems. Although affective appraisai is 
rarely a cur2, ireffectiv2 avopraisai is often a symptom of 


ineffective manacement. Thus, rather than adding to the 


= 
(D 

|-* 
j-4 


Meganize ional dysrunction, it should contribute to the 
being of the institution upon which it has been implemented 
eet. 10:ch. 6). 





tf 
fi! 
j~ 
7) 
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In summary, the impiementation of a personnel apo 
system reguires that the employsces have (aj at least one 
gocd reason to try it, (b) adequate competencies to use 
effectively, and (c) a way to make it part of their ongoing 
jebs rather than a peripheral dnty. 

Additionally, there must be @ positive zeward n 
within the organizational culture to encourage the effective 


use of the appraisal system. 
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III. METHODOLOGY 


A. INTRODUCTION 


The methodolcgy cf the study consisted o 
mearget Sample for the survey, a target for t a 
data collection effcrt, developing a survey inst 

was relevant in terms of the targets, admin Ss 

survey instrument, and finaliy, interpreting the waat the 
Mata derict an formats that are relev O G 


audience (Ss). 


Be. RELIABILITY é&ND VALIDITY 


Two extremely important properties that ali instruments 
Should vossess are reliability and validity. Reliabiiity 
reflects the degree to which the results of the neasurement 
mee tres from e€rior, that is, attributable to systematic 
sources cf variarce [Ref. 28]. Validit reflects the 
dégreée tec which <~ measure actually neasures what i+ purports 


memmeasuze [Ref. 29:0. 7/5]. 


Wee reliability 


= ee ee ee ee 


Reliability cf neasures refers most to the repveat- 
ability of the measure, that the resuits can be duplicated 
Senan nmcrmal linits by additional performances of the 
measure. For exampi¢, geographical surveying techniques are 
Seessitlied accorcing to their inheren* abilitv to measure 
the same geophysical dimensions with repeated accuracy. in 
memae WOLdsS, acccrding to the reliability of the techniqu:. 
Mees 15 analogous to the issue of reliability in the psvcho- 


metric sense as well. 
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Three gereral methods of ensuring reliability cf 
osychometric measures are (a) test and re-test, (b) equiva- 
lent form testing, and (c) split-half +essting. The survey of 
the Coast Guard cfficer corps included equivalent forms of 


the same guesticr in an effort to measure the reliabilty of 


ct 
a 
iD 


survey instrument. 
A measure of the reliability of the survey may he 
jJeveloped by exanining the correlation bpewteen these forms 


in a representative sample of officers. 


2. Validity 


= a a ee 


The valicity of measures genzraily is discussed in 

terms of cone or rore of the following types: (a) content, 
Mme@erearict, (c) criterion-related, (d) face, (¢e) inc 
mentai, (f£) convergent and discriminant,and (g) synthetic 
h 


Memedity. Conten* validity deals with the ability of <= 


ey) 
cf 
aaa 
th) 
4 


measure to cover tne rang? cr domain of the subject o 
Mmmeulcstion. Cors<truct validity deais with the ability <o 
measure abstract variables such as thought vroecesses or 

Merce lLi2zgence. Critericn related validity involves the power 
Seecne Measure as a precdicter of some other attribute, for 


making inferences relative to issues not neasured di 


a 
M 


Cle 
Face validity is exactiy that: a measure that appears, ar 
4¢ast superficially, to measure what it purports to measure. 
Incremental valicity refers to the ability to measure 
Meenemwhat better" than cther tools alre ady avalilarcle. A new 
Meee OF Procedure wouid probably need incremental vaiidity 
betore ae weuld adcpc it over some metnod aiready 
memuse, Convergent cr divergent vaiidity refers to «he 
extent that measures are assessed on their ability <o 
confirm the results alréady shown by other methods. For 
example, a 


test say have convergent validity when the 
ons 


ct 
Hy 


measured values converge on values ated by ancther 


dG 
Beeme KNOWN tc the valid. Pinally, there is synthetic or 
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job~ccmponen*t validity. This final measure is relevant when 
developing tests to measure job skills. A measure would 

Pmtiemovnine. Ce yolidacty Lot a skan diver if it involved 
Separate valid measures of different skin-divirg skilis 


mret. 303sch. 4). 


me shLECTING THE SAMPLE 


Three basic requirements needed *9 be met by the sample. 
First, tne sample had to be from all career fields of the 
Coast Guard. Hopefully, a representative sample wouid 
Begence the Logac of extrapolating the results to the whole 
populaticn sampled . The celi size of the sample areas 
selected shouid re large enough to provide statistical 
Significance to the inferences made from the results and 
enahnce the reiiability of the statistics developed from the 
Sampie. Finaliy, to be frae from regional biases, the 
sample szould bs drawn from all gecgrapvhic areas of assign- 


ment for Coast Guard officers [Ref. 30:ch. 6 


| or | 
e 


D. INSTRUMENTATION 
We Genera: Levelopment: 


The Farvey instrument was developed ina classic 

GB a= deScoitead best by Payne [Ref. 31]. Most basi- 

review cf the present literature on the subjects 
reieated to perscnnel appraisal led to 4 superficiai under- 
n Gz tas ceneral issues. Then, through a process cf 
personal interviews, telephone debates, and observation in 

Nars related to the issues, the framework for ques- 
me c 


lear. USing questionnaires developed for 
Seecc | Stages ci OFMS fRef. 4:ch. 3] and including «he 
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mesil<s OL Much dJnterviem t ime, the author was able to 
synthesize the Line of qu2sticning into a group of questions 
that appeared contextually acceptabis. 

Central *o this effort were the works of Payne 
feet, 31] and the Fert Hoo a 
(Ret. 32). These two reso 


weer lewion tanua . 
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process of develcping the survey iiustrume 


Upon recéipt of the surveys, the raw data were cod 
and entered into an SPSS data file. These data are entirely 
humericai. 

SOme SUDTECtIVITY @x2StsS ig tas data coding . The 
Mes-. end worst features crt tne OPMS, as sclicited by gue¢s- 
fons RZ and R3, were segregated ifto two categories. This 


Bppeared rational at the beginauing of the coding effort. 


ct 
ct 


Later, it became apparent tai 


Meese Gate Could be.better 
VY 


tt. 
in 


@en=9o0s 


(fh) 


represented if ceded ints Fi iS 


= 


See Conten: Analivsis 


et i ee ee i = ee per ae cp 5 ce 


Meacdeye sur the Com gents 1s Ssssentialiy lett undone 


a 


and realiy demands attention. AS &@ ninimal level of 


analysis, ail of the comment piges have been photostatically 
reproduced and fcrwarded to +he Headquarters Analysis Group 
Mer their review. 

Additionally, sé@iected remarks will be used in the 
Beporting of restlits to demenstrate the meaning of the 
numbers, where appropriate. The remarks willl also be used to 
cepict the wide range of controversy surrounding the 
isssues. Finally, an appendix containing representative 
r 


= 
emarks is included in this study. 


+= 





Miresewettorts, wowever. dc not do justice to the 

M@esect amount OL <¢iiortc made by the respondents to accurately 
ema frankly identify their positions concerning the OPMS. It 
is the sincere hcepe of the auther that the nat effect of the 


remarks is not irsignificant. 


YW. Caveats 


}-+4 


The interpretation cf data is a 


in 


ways suk jective 
functicn. There is mere a@ guestion of what degree cf 
subjectivity exists rather than one of its very existance. A 
Major source of this subjectivity can be gemornstrézted by 
viewing the organizational context in which decisions are 


made. Considering the three maidor a omer Orcgeneze t= 


i wee 
iW 


fe on 
Gecision making, that is the rational, bureaucratic, and 
£ 


politicai models, one can demonstrate that the sane data set 
may receive entirely cpposite analysis as 4&4 fesult. of the 
Memen=Ze.10Nal ccnzrext of anmaiySis. This dicrotomy is 4 
result ci the basic assumptions of the models and the 
d:ffering processes cf analysis. Significant: determinants of 
data interpretation are (a) type of organization conducting 
M@renanalysis, (b) position of analyst in that orqanization, 
a 


feeestakeholder(¢) in that organization rel 
Peons Of analysis, and (d) whether the data support 
threaten the position of the organization ¢r the ana 
Thus, the tenor cf the analysis may largely be dependent 
upon where you sit at the time cf analys 

Additionaily, tae numerical ditfere 
eamqd =ne nuances ci interpretation are seldon 
miey Seem. Racher, they tend to sten from pror 
erce in approaches to complex problems. Issu 
ate seldem resolved when teduced to mere arithn 2 
tionships, because the differences lie in the mind of the 
analyst. 





Finally, though the differences in interpretation 
may be philosophically great, they often stem from minor 
differences in numbers. A few hundredths of 2 percentage 
point may spell the difference between success and failure 
for scme adversaries. Yet, the magnitude of the ditfarence 
may seem lilliputian at best. 

Thus one might readily accede to the multiple reali- 
ties inherent in the analysis of data by keeping taese 


Simple maxims ir mind: 


Wace eoocnd=..."=— Of yous pcint OL View, OD 
your stake in the game, on your belief in the 


power of the date, etcerra... 


Pa Seaomenat simp le..,."— other Eactors are 
Heveived, the data iS not representative, the test 


Monies cel 1eblo. efCet Sra. .« 


3. " The difierences are an 


C 
Mmarem@gio che ¥ May be “irc econclliabls, etcetara... 


Nonetheless, the opinion of researchers may vary 
greatiy, and vehement discussion often amirates fron adanan: 
stands on subtle differences whicn are not readi 
nidbie by the cursorv exaMination of the data. Thi 
be the casé with the data collected here; however, it is 

a 


Pesent.al that an effort is nade =o an 


Ee SAMPLE DEMOGFAPHICS 


Dn 


The Sample ccnsisted or five ndred active duty Coas 
Guard Officers. The demographic breakdown of this sample i 
Syown through the SPSS CROSSTABS rfeature. The CROSSTABS ere 


Meeauded in this section. [Ref. 33]. 


"a 
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i. Ereakdowr by Grade 


The sample includes paygrades 01 through 06, Ensign 
through Captain. The mailing of surveys included 500 offi- 
cers of these grades who were stationed throughout «he 


geographic demain of Coast Guard billets. Additionaily, this 


fu 


Maiiing included all accépvted carser f s for Coast Guard 


‘go 

officers. The analysis of responses tnat follows will be 

predicated on the grade of the respondents. Thus, it is 
el = 


2 
en 

mepeopriate at this point to demonstrate @ representative 

Mature of the saupie. The percentages fer the SAMPLE RESULTS 

are as measured ty the survey. The percentag 

ACTUAL FOPULATION are as legislated py Congress. These ars 

listed in [Ref. 324J. The legislated percentage of Oil's and 


@2*]= jis ccmbined as 35.25%. 


The frequency distributions are shown as Tabie I. 


Eight mator career fields were utilized to select 


ct 


Q 
er 
HW 
ti 


officers to te polied. The sampie distribution by 
: 


moeld ae esiown as Table ITI. 


Mm 
r{ 


Pic 20neliy, tne demegnaphic analysi 
fe) 


i" 
oO UW 
ry 


ability to treakcown the respondents by the categ 
asSignment. Nine major lavels of assignment were 
in the data gathered. The sample distribut 


assignment is shcwn as Tabie III. 
UW. Breakdown by Roles and Effects 


Two additional fsatures were measured by the demo- 
gtaphic data collected. The role(s) of the re n 
meenem the OPMS, and the number of office 


respondents throtgh these rcoies. 
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TABLE I 
Officer Distribution by Grade 


SAMPLE RESULTS ACTUAL POPULATION 
Ro REI 

ABSOLUTS FREQ eo Soage, 
CATEGORY LABEL PES (PCT) (PCT) 
CA>TAIN 2 Tiere Gel > 
COMMANDER 22 83 22.0 0 
LCDR 86 Wi 2ees 18200 
LIZSUTENANT 62 233 28.00 
LT JUNICR GRADE CU Zu 2 See > 
ENSIGN 10 3.8 - 
NO RESPONSS 1 0.4 - 

Oe 265 100.0 

GRADE 
C095 
1, HR KK RKERERE ( 20) 
! CAPTAIN 
2, KKK RK RRR | 22) 
TT COMMANDER 
ag 
3 a dk ok kok kk aK KK EKER EK | 36) 
: ne pR 
oe aR oR tok Rok kok RK RRR KK 62) 
BEeUuTeoNANT 
5. soo aoe ok kk kok kok dok kak RK RK ( 64) 
7 br JUNICR GRACE 
6, EKKKEK ( 1C) 
I ENSIGN 
£ 
rire 1 fg 6 om se Lesecce a RLS ay ee DO er ee 
0 5 100 
0 ee 
fee Dp CASES 264 WES SENG Casts 4 


It is an accurate assumption that the roles 
portrayed are Sequential and hierarchical. That is, th 
@ respondent indicates a role as Reporting Officer, he also 
memes the DeSic functions of Reported on Officer and 
Seer VvisSor, aS well. Thus, tnough it is not clearly shown 
in the SPSS breakdown of the data, each supervisor is also a 
reported on officer. The subordinate roles can be augmented 


by the reader in this manner, if he so chooses. 
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TABLE {ff 


Sample Distribution by Career Field 


CAREER SPECIALTY 
RELATIVE 
ABSOLG Hs FREO 
@areSGORY LAssl oe Heo) 
SURFACE OPERATIONS 5 sae 
AVIATION 4Y7 Tie 
ENGINEER 50 18.9 
MIO MEP 50 18.9 
MANPWR EERS TRNG Za 7.9 
FINANCE SUPPLY 8 3.9 
LEGAL Ti Jes 08 
OTHER 9 Be 4 
NO RESPONSE 5 1.9 
Ot AL 265 10). 0 
CAREZh SPECIALTY 
CODE 


etek tok zk tok 3 pice kk tok eK ok tok deka ok 
pun’ AGewOF ERA THONS 


weeeeD CASES 265 WesoLNGucas.2S 

The final demographics, roles in 
officers supervised, and number cf o 
reported on are 


respectively. 


43 


Snewnoen Caples IV, Tanie 


2 
1 
i 
2. SOR ROE tok ebook kK EK | 47) 
AVIATION 
30 FOR oo 4k ek doe e dok tok tok ( 50) 
im ENGINEER 
YS doko yok ok dre dak aoiok aka tok ( 50) 
: bao MEP 
Bo RRR ROR ( 21) 
: MANPWe PoeRS TENG 
6. **RKK 8) 
: FINANCE SUPPL 
Go Fee 7) 
LEGAL 
8. eK Cy 
mm OTHER 
a8 
GS, **% { 5) 
af 
I 
Mtr. 4 5 154 c0c wesc elLeeeeee So JG A rece cee 6 OG ee 
0 2 0 
px BOO ENCY 


ADJUSTED Git 
FREO tints © 
a ee 

5 Ser? 
View ree 
1832 62,3 
18.9 Slee 

7.9 89.1 

Be, ee 

26 94.7 

ees 98.1 
1.9 100.0 
oo.. 0 
6 8) 
oe ti 
100 
QENS Dumber OF 


g 





TABLE Iii 


Distribution hy Duty Ass 


RELATIVE 
ABSOLUTE FREQ 
CATEGORY LABEL FREQ (PCT) 
MOMNANDING OFFICER Z 10.6 
PeecuriV= OFFICEE 19 eee 
BeenatICNS OFFICER 4 Te 
Pac OPS 7 206 
DIVISION CHIEF 18 6.8 
BeaNCH CHIct 24 ok 
Mee UTY ERANCH CHIEF Ag Sir 
CTHER 30 11.3 
Hee RESPONSE 113 42.6 
TOTAL 265 100.0 
DUTY ASSIGNUENT 
CODE 
reer ere 23) 
: GOMNMANDING OF FICER 
26 KKK 1S) 
: BAECUTIVS OFFICER 
oe ex ub) 
: Wee RAD LONS OFFICER 
a +k 7) 
: tr rOPs 
SAR ( 1 §) 
: PeeViSiON CHIEF 
6. RR RR RK zu) 
z BeANCH CHIEF 
Te dk Ko Z2) 
a BoeuUTY BRANCH CHIE 
G, Ke RRR | 30; 
z OTHER 
Qk FR OR SOR dO OK Sak dK OK BE ( 1 
i Peal oPONSS 
DEErtce ero. L 6s eee ew 6 « Lewee cee wool *@es#e#@ ¢ @ 
0 120 
9 PREOU ENC Y 


feet D CASES 265 WiSSsiiGecas 


gS 


ignment 


ONDA ~WVO ONO! IDG 


eee @ & © © &© CYT 


ODO FODN~ION HHO 


ad 





TABLE IV 
Distribution by OPMS Roles 


RELATIVE ADJUSTED CUM 
ABSOLUTE 1 ee FEES ae on, 
CATEGORY LABEL oe (PCT) (PCT) (TCT) 
meeORTED ON OFFICER eZ “7.9 47.9 FIRS, 
SUPERVISING OFFICER 6 & 24.2 Bae Vi (pm 
REPORTING OFFICER 40 15m Noes ove? 
REVIEWING OFFICER 33 125 Zo Shs) Rae 
GTAER ROLE 1 0.4 0.4 190.0 
TOT AE 26> 109.0 100.0 
PeeoaNtT ROLES IN OPUS 
Sot 
1.0 Xk et fk dk dk dk ok kok kk ek ok kk 7) 
: REFORTED ON OFFICER 
20 KR RK AK RK AKERS ( 6 4) 
SUIPERVEISING OFFICER 
Qe eK a ok ek 40) 
z PePORELING OFFICER 
Kk eae ok 33) 
: MmeviSwiNG OFFICER 
5) 1 
ue OTHER ROLE 
7. ~~? | oo 6 6 e ce ee Loewe cee rae fore aeee sco Glee-ees wu 
0 80 120 160 200 
FREQUENCY 
WADED CASES 265 HW iSewnG GAS SS 0 
fe OUMMARY 
These tables present the data as of 7 February 19933. At 
Mies DOLNt in tine, 265 responses were received by «he 
author. Additional, responses will be included in the 


mews Orical filés to be provided to the Commandant, U.S. 
Coast Guard, if received. However, thea data analysis will 
proceed [rom this pcint predicated on 265 cases. 

The foliowing chapter wili present responses to sidqnifi- 


cant issues posed by the author's survey effort. 
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TABLE V 


Distribution by Number Supervised 


RELATIVE ADJUSTED CUM 
BBSOLUTE FREO FREO FREQ 
CATEGORY LAFEL FREQ (PCT) (PCT) (PCT) 
SUPERCON NONE 13 49.4 re ey, ug.2 
SUP FRON1-3 8 3 31.3 546m 80.7 
SUP ERONY-6 35 13.2 13.3 93.9 
SUP ERONT-9 11 2 u.2 ee 
SUP ERON 10-12 2 0.8 0.8 98.9 
SUP ERON 13-15 1 0.4 O.g aon 2 
SUP EFRON 16-18 1 O.4 0.4 99.6 
SUP ERON 19-21 1 0.4 0.4 100.0 
NO RESPONSE 1 0.4 MISSING 100.0 
TOTAL 265 100.0 eo. 0 
FILE NONAME (CREATION DATE = 02/01/83) 
NUMBER SUPERVISEL 
CODE 
0. eo ok doko doko eo doko dk dok ak kK ( 130) 
I SUPERVISE NONE 
a sto $k da oka tok RK ( 83) 
: SUPERVISE 1-3 
2. eK RRR EK ( 35) 
: SUPERVISE 4-6 
eo. Boon t i 
3 SUPERVISE 7- 
Hh. «x 2) 
I SUPERVISE 10-12 
ee Fy { 1) 
: SUPERVISE 13-15 
6. * { 1) 
I SUPERVISE 16-18 
a * ( 1) 
I SUPERVIS® 19-21 
DWENEIITENc sc ceolLcecsecscee lees ee @e8 @ eo ~#ee#8e#8ese# Din rave? Sakata & 
0 8 120 160 200 
FREQUENCY 
aiid CASES 264 MISSING CASES 1 





CATEGORY LABEL 
REPORT NONE 


Paste vt 
Distribution by Number Reported On 


and Supervised 
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PecOrt1=3 
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REPORT4H— 
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Ae SURVZY ANALYSIS 


The autnorc's analysis is centered on issues of great 
Sencern. iF the OPMS is to be utilized to its fullest 
Meeertial, then it must be accepted by the cfficer corps. It 
is unclear at this point what the exact level of accep*ance 
Smould re to spell acceptance. A " praponderance " of the 
Gee Srould suppcrt the OPMS iz it is to be concluded that 
the system has been Leen accepted. 

What exactly constitutes a preponderance is also 
iear. Surely, if the data are ,say, four-to-one in one 
@2recticn or the other, that is preponderence in the 
e@erer’S mind. Ferhaps even @ two-to-one ratic is " prepon- 
magee ". where tne data are less clear-cut «han this, the 
reader will have to decide for himself whether the décza are 
Memetiesce. Cc. OF contrary to she OPMS. 


In this regard, the repsonses to the survey questions 


Meve Desr~ categorized in two classes , "Agree" ard "Do not 
Agree ", Weutral repsonses have been included in the "Deo 
not Agree" categcery. This has teen done tc sharply demons- 
trate tue dichotcmy of the response set between those who 
did clearly state their agreement with the statements pesed 
and those who dic not stare their agr2zement with the state- 


re) 
Ments. A more Specific breakdown of the responses is 
u 


@ed in Apperdaix A. 


The overall reaction to the OPMS was measured by tne 
first statement cf the survey, R11. This element is quoted 


below. The respcnse to this question is shown in «he 





Pele'CoOns.decone ali of Four experiences £0 far with the 
Po Vompeecess,s «dt 25 your Overall reaction to tno 
entire Systen?" 

SABLE VIL 


Cverali kKeactior to the OPMS 


R 1 Positive Not Positive 
Capt 40.0% 60.0% 
CDR 37.87. 68.2% 
LCDR Bo. O04 60.4% 
10g 42.6% a7 4S 
LTJG 57. om U2. 2% 
ENS 60.0% uO. 0% 
Distribution 
By Total Sample bu 95 55.1% 
The Cespense te C122 gusestion shows that the officer 
Meeps is split ir its reactcon the the OPMS. The best means 
of analyzing these results may be in terms of what the 
expected results might have been. If the reader required an 


eyerwheiming sctatistic, for or against, to support an 
o 


hypotnesis, then these results clearly do not support the 


| 
by 
O 
= 
0 


meraer'’s hypotheses. in the author's mind, this table 
jukewarm suppert of the OPMS in génerai terms, not on 
specific issues. 

A different presentation of these same data may 


"sw of «=ne data. An 


f) 
x. 
oy) 
4% 
} 4 
hh 
rh 
D 
a 
(D 
= 
ct 


eeeeow the reader to dr v 

Seemole Of this is provided in Table VIII,Iin this table, a 

joree COlUmn [TOorwat may allow the reader to think in 

Specific terms ccncerning those who do not support the OPMS 

With their positive responses on the survey. This presenta- 
2 


Beem coes rot clarify the issues in the mind of «th 


25 





Mather, it Serves tO Cloud the response dichetomy. As such, 
S 


th 


ormat will not be used in further analyses and is 


FABLE VYiilt 
Cverall Reaction to the CGPMS 


R1 Positive Neutral Not Positive 
Capt 40 .0% Pas ne Ube Shays ay 

CDR S148 4 Ogos 2343% 
LCDR 39 .6% 44.2% See 26 

ly 42.6% 34 4% Zo. 0% 
LTJG Sl ein 31.3% 1G lhe 

ENS 60.0% 40.0% 00.0% 
Distrib 

By 

Tct Sample 44 9% 36.9% ee 2% 


proviced here fer infcrmational purposes only. 


These sane data presente 


Ou 
}+ 
ia 
ey 
ag tls 
{- 


eet permit the conclusion thaz only 44 
mees Would VCO1LCé tneir subperct of the OPMS, 
that the remainirg sector of tne Sa 
fee= SUupporz. The reader will find the frequency of 


response to each question in Appendix 4A. 


fe OPMS 2s Uniformly Aodliea ? 


See = UD = wom apo sew oe Oe 


The percepticns of the offi eoneecn 1G stune 


Ss 

MeecOrm application of the OPMS wer ed through the 
use of three questions, AS, A Aj 
question AQ whick is qucted be 


Mmeeeos shcown in Teble IX. 


A9 "The OPMS _be 
ce 


is Ag apo DilLedeuntrosmays ce all gqradas of 
Coast Guard offi s 


« 
— 
—_ 
=— @ 





TABLE I 
OPMS is Applied Uniformly by Grade ? 


Ag Agree Bownet Agrees 
Capt US aie 64.2% 

CDR 168.2% 81.8% 

LCD R 10.1% 89.9% 

Oa 8.3% 91.7% 
LTJG Wea eke San 

ENS Dae 77.8% 
Distribution 

By Totai Sample 12.0% 88.0% 


iment sees tence, 2=hewdata ds dsmonstzrate aelarning 
mistrust of the application of the OPMS. The perception of 
mimerorticer corps is clearly that the OPMS is not applied 
uniformly to all grades of Coast Guard cfficers. Eff 
disprove this perception may weli one necessary for corps- 


wide acceptance cr the OPMS. 


N 


Survey element A10 is quoted below. The response 20 


= 


sais ¢lemen= is shown in Tables 


A10 "The OPMS is being 4 
fields for Coast Guard 9 


A Ysummarty Of this dimension affirms the aistrust 
mevealed in question AJ. To tne author, this mistrust is 
gquizte alarming ! 

Survey element All tests this issue yet another way, 
ByeGuty asSignmertaWw#hile it was intended that this questio 
Specifically measure attitude as a function of gecgraphic 


meee Of aSSignmert, cr distric retrospective anaiysis of 


ot 
p- “ 


the question may reveal thar LS question does not expli- 
Sk 


Beery accomplish this ta Thus, the analyses is left in 


oe 





TABLE X 


OPMS is Applied Uniformly by Careers ? 
A10 Agrees Do not Agres 
Capt 11.7% 88.9% 
CDR 4.8% Oe 
EDR Gs1 % 93.3% 
hail 5.1% 94.9% 
LTJG USS Sy 84.1% 
ENS 00.0% 100.0% 
Peasctricution 
By Totaéi Sample S07 re, 0% 
more general *erms. This survey item is quoted below; the 
results are shown in Table XI. 
Ali "The OPMS is ad BO eeaeune Orly an ali duty 
EoscgnmentS taroughcut tae Coast Guard." 

Analysis of this question demonstrates the pervasive 
perception that the OPMS is net used the same way everywhers 
Mmaecne Ccast Guard, nor in every career field, nor is it 
perceived tc be eppiied th2 same way to every grade. 

ee OPS 25 Korth the sfifors ? 

The attitudes of the officer corps regarding «he 
relative payback of tne OPMS were measured using questions 
A24W, A25, and A26é. The responses to these questions are 
Summarized in tatrular form. 
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TASB RE AL 
OPMS Applied Uniformly by Assignm't? 


A111 Aqree Do not Agree 
Capt ats 88.9% 

CDR 00.0% Keke marek: 
LCDR 6.6% 93.4% 

Hay 09.0% 1060.7 
LTJG pene SOs 

ENS 00.90% 100.0% 

Pas tribution 

By Total Sample Sets 94.3% 


Question A24 measures the attitude rega 


4 


aq 
wWeetn Of the eff in counseling subordinates. The 


Gre 
responses are rerorted in Table XII. 


A24 "The 43 


al n documenting, 
seling, and c a 


CS are worth 


A summary of these data is th 
e 


amopiguity in the perce S$ on this 
Sesue. Certainiy, the response to the question does not show 
mmat ~he officer corps clearly perceives that the effort 
Beguired by the CPMS by seniors towards their juniors is 
Meworth it “. This indicates iukewarm commitment to this 


facet of the QPME at best. 


Ouestion A25 tests this issue in ancther direction, 


a 
towards seniors. The question is quoted here; the resuits 


are reported in Tapbie XIilI. 





TAELE Xit 
Effcrt Spent on Juniors Worth It? 


A24 Agree Do not Agree 
Capt ee a 52. 6% 
CDR 36. 3h 63.7% 
BED R 3 ech 40.7% 
aT 5 ah 63.5% 
LTJG 20a 7 Toe 
DNS G2.9% Ble ts 
Bese tbation 
By Total Sample 43.5% 2:05) 
mee "The time and effort I spend on documenting, courn- 
Pee epecnd Leedback with My Superiorts ars worth it." 
TAeGe ALLL 
iew@ere  ODeCHt Of Sensors WoOEth It? 
A25 Agree Do not Agzres 
Capt 26.4% 135s Sol 
CDR Dope eee 
BoD R eet reo. 42.7% 
gy 43.3% a2e1 4 
LTJG Wi0ee 206 7S 
ENS 50.0% 50200. 
feet ibution 
By Total Sample SALTS 47.9% 
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the akba 


ni Vv 
ner the OPMS prt 


A summary of these data atti 


ry 
7) 


D 


the officer corps, this concerning wh O 
mee WOrtnh it ™ “hen working with senicrs. The mixed ac 
tance of these issues may indicate a lukewarm commitment <= 
the use cf these processes by Coast Guard officers, «sp 
cially the senior grades of Captain and Commandez. ei ma 
undermine the entire OPMS. 

Question A26 méasures this dimension ovetall by 
asking whether tke OFMS pays back what is put into it. The 


responses are shewn in Table XIV. 


meoe in general, =he OPMS pays back what ZI rut into it." 


TABLE XLV 
OPMS has a Good Payback ? 


Aee Aqree DO NOt AgGrese 
Capt Sali.G.0 63.4% 

CDR Zod 7s aes 

LCDR 38.62 Sees. t 

reg 56.00 Sones 
LTJG Bi ans 42.9% 

ENS ae eys SOO 

Paso tcabution 

By Totai Sample 41.3% Se tas 


These responses confirm what what has been hinted 


re, 
ct 
1) 


Preceedince twe questions. With only 41.3% of tke 


-4- 


ccrps perceive a valid payback,the OPMS is net on 


iD 
ia 
ct 
jy 
rs OS hme = 
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fecind secon] 2NPCr antl vy, <h= sensor officsts, those 





% 


with the power tc make or break a poiicy and who are also ir 
the key-use roles in the system, are decidedly necative on 


this issue. 


p oe 

6 
I 
fom 
lod 
It 
kD 
Ip. 
iM 
Ing 
It 
ia 
Ith 
te 
Ha 


MORENO is is were alie 


!'U 


Mie aucatudes GE she officer Corps cOoncerRing prior 
ities, wecrkload éend additional OPMS priorities was neasured 


using guestions 427, A28, and A29. 


Oyestion AZ? concerns On-che-job time available for 
the perfcrmance cf OFMS duties. The resuits are ambivalent: 


they are shcwn ir Table XV. 


A27."I have encugh tine on my job to perforna my OPS 
aucies." 


SUS poe, > G'/ 
There is Enough Time on the Job ? 


997 Agree DO no* Agres 
Capt 40.0% 60.0% 

CDR VAP: Load 

LCD kk WO.7% ye) amelie 

i, T 48.3% oa. /7 
LTJG 62.5% Ota oe 

ENS 60.0% 40.0% 
Distribution 

By Total Sample 47.2% 52. 3% 





The data on this issue are ambivalent when viewed 
everall. Once eqein, however, 04's, 05's, and O6'S ares 
decidediy negative. 

Question A28 seeks response to another issue, 
whether OPMS duties hinder the performance of other duties 
assigned to Coast Guard officers. The results are shown in 
Table XVI. 


A238 "The performance of my OPMS duties doss not hinder 
the performance of my other primary duties." 


TABLE XVI 
OPMS Does Not Hinder Primary Duty ? 


Oe Agree DO not Agree 
Capt SOlTOh GO.0% 

CDR Bt cite OG e 
LCDR 45.3% 54.7% 

Jnl 46.6% 53.4% 
LTJG Se tie i 

ENS 70.0% B00 % 
Bescribution 

By Total Sample 4U8.8% Sie 2a 


A summary of this table indicates that the percep- 
meen Of the officer corps is counter to the hypothesis. The 


response +o A28 does iniicate ambivaience of the officers 
sampled in the survey process. 


Or 
7) 





Question A29 seeks Similar infcrmaticn in another 
dimension, whether ccllateral duties are hindered by the 


OPMS juties. The responses are shown in Table XVII. 


A29 "The performance of ny OPMS duties does nou meander 
@he performance of my collateral duties.’ 


TABLE XVII 
OPMS Does Not Einder Collaterals ? 


Ho6 Agree DO nOt Agree 
Capt 60.0% uO. 0% 

COR 31.3% OGs.2 0 
DR 38.9% 61. 1% 

i 41.6% 53.4% 
LTJIG 52 9s ee 

ENS 50.0% 40.0% 

es er ipution 

Ey Total Sample 46.0% 54.0% 


A summary analysis cf tais response again indicates 
Maeecuity. cCerteinly, the cfficer corps is not strong in 
support of this issue. This issue remains aS an area of 


Moncerii. 


Ticwie: “Ghasmemmche te 1S gaycelt need for change is an 
important factor in instituting any change in an organiza- 
tion. The strength cf this felt need was measured by 


gestions A35, A=6, A37, and A38. 





Survey 


are perfcrming their duties as perceived by 


A35 questions whether the supervisors 


tne OfEL Cars 


reported con. The results are shown in Table XVIII. 
A35 "My supervisor is performing his OPMS duties as 
Segqusrea Ly the regulations." 
eS eek Vo ee 
Supervisors Perform OPMS Duty ? 

35 Agrees Do not Agree 
Capt 49.0% 60.0% 
CDR 45.4% at tema 
EoD & 43.1% 56.9% 
LT 42.6% i 
LTJG Dig UZ. 2% 
ENS 60.90% 40.0% 
Bestti bution 
By Toté:i Sample U7. 1% 52897 

These data definitely indicate a problem here. When 
Meme than halt of the senior cfficer corps indicates that 
fe. Seniors are net periorming their OPMS functions, then 
feed t1eg should weve in the face of the analyst. This 
type of non-perfcrmance indicates a problem; whether «the 
problem ilies wittr the people or the system is not revealed 
the data. 

Question A36 sugg2StS that no improvements are 
Meeessery for the OPMS evaluation process. The cfiicer corps 
dces not support this suggestion. The results are shown in 


Table XIX. 





A36 "No imprevemnts to the OPMS are necessary to nake it 
an effective tcol for performance evaluation. 
TASLE ZIX 
Ne Improveuents for CPMS PE ? 
A36 Agree [Co net Agres 
Capt D504 94.7% 
DR 00.0% 100.0% 
ECD R ul 7% ie 3 5 
itp 4.9% Oo eelte 
LTJG 14.1% Sere oit 
ENS 10.0% 90.0% 
Des oc LDUtion 
By Total Sample S225 SI ren 


An analysis of these data indicates an overwhelming fel: 


vt 


need for improvesent in *a2 performance evaluation process 
as posed by question A36. 

Cuestion A37 poses the same issue, but refeérs to the 
PeomoOtiecn and selection process. The response =o this is is 


shown in Table Xx. 


"NO imptovements to the OPMS area néecessary,+to nake it an 
SeeecCoAVe tool for selecting qualified officers for 
paomOt_on." 
ow 
The respense indicate 


Ss overwhelming dissatisfaction 
M 


Ae) 


With this dimension cf the OPMS. This is definitely an area 


- ‘ Sea : if 
Memmconcern regatding the organizationa. context or syste 
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TABLE ok 
No Changes to OPMS / Promotion ? 


A37 Agree De not Agres 
Capt 10. Sk 89.5% 

CDR 00.0% 100.9% 
LCD& are. 94.4% 

oT 4.9% 9520 .k 
LTJIG 11.0% 89. Oa 

ENS 10075 90. OP 

Bes cro ibution 

By Total Sample 6. 9% 93.78 


fit" of the OPMS with pre-existing numan resenrce orograms. 
This degree of relt need for change nay well stand in ‘the 
way Of any further acceptance of this system by ths officer 
Berps. 

Survey element A38 rephrased the issn: and gques- 

venen tn the OPMS 

Mmimeececr and prcmotion functions. The tespesse is shown in 
Tabie XXI. 


tions the felt need for immediate inpre 


mo 'immediate lmrrovemnts to the OPMS are iecessary =o 
Peewee. Al SELEective tool for selecting qualircried orffi- 


as £OL Promotion." 


This equivalent form of the preceeding question 
se 


4 


ry? 
iD 
tH 
13) 
- 
ALR 
| 
p 
@ 
fu 
th 


confirms 


’ 


oz change to the OPMS along the 
d-mension of selection and promotion. This may weil hinder 
aD 


the acceptance of this PG dicalmenlne stomee: che OPMS. 


67 





TABLE XXI 


OFMS Improvements Necessary ? 


A38 Agree Do not Agree 

Geapt 88.8% Vee 

CDR 90.9% 9.1% 

LCDR 84.7% 15.3% 

ty 83.4% 16.6% 

LTJG 78.1% 2 9 

ENS 80.0% 202 0% 

Distribution 

By Totai Sample Sit, 16.6% 
Seperts 2s GedaniZarronaily Right ? 

Bnemdles ton Of O=G anazational f7t oS vital. Tt is 
absolutely necessary that a performance appraisal system be 
BPepeeived as “ricnt for the organization" for that system to 
succeed. A measure of the attitudes of Coast Guard officers 
Concerning this cimension was gathered usirg questions A39, 
A40, and A411. 

Wiese On ASF Les=s the Overali voerception cr “"Tignt 
meee LOr the OP¥WS and counseling, development, and supervi- 


sory functions. The responses on this issue ar2 shown in 
meole XXII. 
Meet AS Gn O©rgenizeation, we are doing the right thirg by 
using this system (OPMS} for development and supervi- 
Seon. 
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DABBLE ZXUEL 


OP¥S Fits Supervision / Growth ? 


B39 Agree Do net Agree 
Capt 60.0% 40.0% 

CDR 45.4% 5 ao. 
LCDR 65.1% S45 9% 

ET Bla Me 45.9% 
LTJG 79.7% 20a 3 4 

ENS 80.0% Coeno ts 
Beoer ibuticn 

By Total Sample 64.6% 356202 

Am anelysis ci questicn A339 indicates a more posi-~ 
tive ratio for OEMS, nearly «wo to one in favor. Yet the 
support is not overwhelming. 

Question AYD poses this issue cn another dimension, 
megeeness fcr sélecticn and promotion functions. Table XXIzi 
haS the rtesuits. 

meee AS an Obgenization, we are doing tae right thing by 
Meeiiciad ofticerss aSQene paste .6Or or Cmnoting 
imemrespense tO this @sste, AY0, i] nearly the 


reverse cf the previcus resuits. This may indicate 
mteevalence of tke cfficer corps cencerning the 
issues posed by the questions. 


The OPMS is a system OF management by objecti 


oD < 
ct 
5 
i: 
" 


(MBO). One cannot deny this fact. Attempts to disguis 


Basic issue may te perceived as insulting, if nox 


condescending, by the the corps. The officer corps 
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TREE XLLIL 
OPMS Fits Selection / Promoticn ? 


AUC Agree Do not Agree 

Capt 35.0% 65.0% 

C DE. Die Ih Fas 7 

LeU R 30565 69.4% 

ak PAs B\ ry PANE Vater 

LTUG 320% 67< 2% 

ENS 50.0% 50.0% 

Beestribution by 

Total Sample 30.5% 69.5% 

Opposed to MOB, fer sé, aS may have been feared previously. 
By testing the ettitudes of Coast Guard Officers reievant 
to MBO , questior AY attempts to measure how the convrs, 
Smeeecit, perceives the " rightness of fit ™ for MBO and the 


Coust Guard. Takle XXIV demonstrates the response of the 
Pere cO the issue of " rightness " of MBO for the Coast 


Guard officer maragement system. 


A447 "Management by objectives is an appropriate aporcach 
te een oS vezrsonhnel management ror use in tne Coast 
Guar e ¢ 


A summary cf these data on MBO indicates a fair 


Support base for MBO, at least superficially. 


7. Do We Reeliv Knew Enough to be Faiz? 


BGWaey 2S en SVer present iSsue in Evaivebing the 
efficacy and acceptance cf an aporaisali system. To be fair-- 
memone'’s Seif, as well as to others-- requires a degree of 
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TABLE XX1LV 


MBO Right Personnel Management ? 


AG Agrée Do not Agree 
Capt G 550% 35.90% 

CDR 63574 36. 3% 
LCDE 56.5% 43.5% 

ay 64.0% Bion 0. 
LTJG 71.9% ZO elk 

ENS 7 Os0% 305 0% 
Distribution 

By Total Sample 64.6% S50 


knowledge cconézrning the integration and articulation of this 
system, OOMS , and its réelaticnship with the promotion and 
selection process as well as other human resource programs. 
Memmeasire che percertions of the officer corps on this 
feature, equity, cuestiorns A112, SK5, SK6, and SK7 were used 
Bethe surv 

Question Al2 poses the issue of clarity in the use 
Memaiimcoecs in the OPR. Essentially, for the a eee et 
any evaluaticn te be equitable, the constructs used to make 
Meecthat evaivaticr must be clear to all. There is no rocn 
¢ion on marks. Table XXV provides the breakdown of 


Res to this issue. 


{n 


mee ine documentation and instructions provided with 
the OFMS assure there PSO Contuscom in Pee 2 
numerical evaluaticns to Coast Guard officers." 
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TABLE XxXV 


TretlucticonsS ecevent Confusion  ? 


A12 Agree Do not Agree 
Capt 15°. 085 gis 0% 

CDR 9.1% 90.9% 

ECD R ay aie 88.4% 

ital 8.27 91.38% 
LTJG 27.0% 473205 

ENS 20.0% BO ave: a 
fests tbution 

By Totel Sample 1 has 84.0% 


AI2, clearly poirts O 
who most use the OPMS are these most negative. 
alarming tesponse to the author. It is a cause fo 
concern Zor those who would seek to improve any facet of the 
OEMS . 
Me test this issue curther, Questicns SK5 and SK6 
, 


fF the numbers that might be 


xe 

ask for response concerning the assignment of numbers on the 
OPR and the subsequent impact o 
W 


assigned. The results are shown in Table XXVI and Table 


XVII respectively. 


seo "The numerical evaluation of thres is whazt the 
Majority of orficers snould receive. 


GZ 





Pepe fen tk 


Most Officers Receive 3ts 

SK5 Agree De Te. 
Capt 65.0% S55 Us 
CDR 52.4% U7. 6% 
LCDE 62.8% S722 
io 5) 46 U2. 47 
LTJG 53. x 42.9% 
ENS 80.0% 202 0 
Destribution 

By Total Sample 59. 2h UO. 3% 


The respcnse to question SK5 is 
itself; it merely shows ambivalence reg 
of the number three on the OPR. Ye h 
considered with these data, then the c 
matter becomes apparent. Many officers 
Beoper to assign the majority of office 
yet, they overwhelminrgly perceive that 


fiees LCD Dromotion.it would be logical 


Seme Officers wovld fester the nonpromoticr of 7. 


Seetne corps; yet, this is obviously ro: 
O 


Thus, the ambivalence resuits ict 


precess cf assigning numbers <o tha OPR 


concerning their impact on promotion. Ce 


looms to biock stccessful integraticn a 


erns. 


SK6 "The numerical evaluaticn_o€. 
assure the proroticr of a gqualiz 


pe: 


On OPR? 


ray) 

le 
ry 
(i 
@ 


Reon ecuusi ve Hy 
arding the assignment 


Pho euest. On SKS as 


onfuszion cn this 


Cooney. chs mssue 


nd acceptance of the 





Begs AAV oT 


A 32is Sufficient for Promoticn? 


Agree Do not Agree 

SK6 

Capt 10.0% 90.0% 

CDR 4.8% 93a 27. 

LCDR 10.7% 89.3% 

Et 11298 88.1% 

LTJG PPL CPx sie’ 

ENS 20.0% 80.0% 

pests Tbution 

By Total Sample 64.6% 35.4% 


tae Saqunry Cea tne OPMS ls further explored by gues- 
tion SK7. This question probes the issue of Fairness as @ 
function of system knewledge. Table XXVIII shows the 


response the resronses to this issue. 


oe ''f am Satisfied that I k 
Mereue ©f numerical marks ¢ 
others." 


Cw enough concern 
= 


ching the 
ba2© £0 M¥Seif anc 


The strergth of this response, when viewed in the 
Memtext Of the preceeding two questions, indicates 


m@eeeconcern for tte OPMS. The dichotomy o 


r Sp q 
tions SK5 and SKE points to confusion. The stark statement 
gathered in SK7 indicates summarily that the groundwerk for 
inequity has been laid and may well vérmeate the OPMS unless 
this issue is dealt with. Clearly 90.0% of the senior offi- 
cers polled are confused on these issues. There is basis for 


alarm here. 
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TABLE XXVIII 


We Know Enough to be Fair? 


Sk7 Agree Do not agree 
eap< 25.0% Te % 
CDR 23.37 Wiis 270 
LCDR igi ss 82.4% 
ay 135,37 86.7% 
LTJG 16.1% 83.9% 
ENS 20.0% 80.0% 
beste ibution 
By Total Sample iiss S26 6 

8. Do We Knew What Performance =s Necc2ssaty fer 

Promotion ? 


The objectives of appraisal systems may De manv and 
Meeted, The essertial ingredient is thet they are deli- 
Meaceac. A Specific function of the OPMS is the link of 
appraisal tc promoticn. An appraisal system so linked to 
promotion can be most effective by claarly and consistenzl 
advertising and rewarding the global set of behavicrs, 
activities, and actions that it desires of those whom it 
would serve to promote. Behaviorists teach us that an crgqan- 
ization may best modify behavior, or develop the 


% 


BemeesstOnalism ci the officer corps, by sffectively adver- 


~ 


( 


tising what behavior is desired, and then stroking that 
Meaavio= through the crganizational ctewazrd system, that is 
the appraisal system. To this end, an aporaisal system mus 
have clear goals and clear rewards. The path between *the two 
needs tc be clear, consistent, and unobstructed. 

To measure the percepticns of the o 
regarding this issue, questions R25, SkK1i22, and Sk12b were 


used. 


tia) 





Question R25 poses the issue of clarity versus 
confusicn ccncerring numbers which are assigned to an offi- 
cer's OPR, and the impact of those numbers on promotability. 
The paradigm is, essentially, that wher2 confusion reigns 
clarity of purpose is lost. Table XXIX disvlays the overall 


Reaction of the sample to this issue. 


Peo 'l am confused concerning the 2 miele oF Pena are... 
numbe-s Oi he ©PR have On tne promotabiizty or offi- 
cers. 

TABLE XxXIXx 


Numbers and Promotability Confusing? 


R25 Agree Do not Agree 
Capt 68.4% Shales (ote 

CDR 4) Seve PAPI 
LCDR IMATE PW Poa pi 

LT 82.0% 18.0% 
LTJG Bi. 2% 18.8% 

ENS 80.0% ZU 0% 
Distribut ion 

By Total Sample 79.0% Diet Oice 


The respcense to 825 is quite revealing. Clearly 


Memon OC. the senior officers polled are not certain of the 


impact their appraisals may have . This type of uncertainty 
breeds the inflationary trends that were cited as the basis 
opm mee ing the previcus PA system, the Officer Fitness 


ry 
o 


ng System. 
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pues AS 


re 


sue is further explored with questions SK12A 
he OPMS helps an 


+o determine which performance (s) 


Heri the issue is whether 
are organization- 
a5) Te shown 


an Table XXX and Table XXxXI. 


araed with promo The summary results 4éreée 


SK122 "My knowledge of the OPMS enables me to determine 
what pericrmance 1s necessary to assure the promotion 
meee CL CSServing juniors. 
TABLE XXX 
Know What is Required of Juniors? 
SK12A Agree Do not Agree 
Capt 1550% spores 
CDR 19.0% 81.9% 
LCDR Pada 6% Gis lcs 
isi 6.9% 03 a 
E206 22.0% 7 Ome 
ENS 14.3% 85.7% 
Meser tbuticn 
By Total Sample 17.1% a2 one 


SKI2B "Ny knowledge of the OPMS enables me to determin 
What pericrmance is necessary to assure tne promotion 
mee 6€6UC CU ySeli.t 


a 





TABLE XXxXI 
Krow What is Required of Self? 


241228 Agree Do not Agree 
Capt oe 6 85.54 

CDR 1s 85.7% 

LCD R 20 49% 80.0% 

LT NU aoe 90.07 
LTJG AD i 3eon 

ENS 202.0% 80.0% 
Beater 2 Du tion 

By Total Sample esl, Sb cules 


mance 
G@ecered by the service, since it is unknown . Multitudes of 
Behev2Orists would find this to be quite alarming. Given 
that a stated obtective of the OPMS was the growth and 
deveicpment of tke officer corps, one might conciude that it 
has failed to meet its ahjectives on the basis of these last 
two responses. 


eee CONCLUSIONS 


These findincs tend te Support tne the 


Ss 
Bhatia in @ study or personnel appraisal in gover 
£ 


nment 
Meet. 35). Bhatia's study discloses that fewer’ *han 38.3% 
of the Fortune 5C0 ccmpanies report highly successful MBO 
implementations. He goes on to question the efficacy cf MBO 
in government orcanization by asking biuntly, " Can i+ 


really work7t 
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Cc 


nm 


The initial analyses of the survey results ind 
the support base requisite for success does not exist =oday 
in the U.S. Coast Guard. rathe there is at best a lukewarn 
acceptance of the service's major M30 effort, the CPHS. 
Where there is resistanc? to the OPMS, it is rampant. 

The responderts to this study, and by extension, the 
Coast Guard Officer Corps, show high resistance to the OPMS 
in areas of (1) unifcrm applicability cf the system, (2) 
payback-- whether it is worth the effort, (3) priority-- 
Pleat it interferes with @xisting priorities, (4) organiza- 
tional context-- whether it is right for the service, (5) 
egquity-- that it may not fairly measure performance cr 
potentiai, and (€) reward structure-- that the system does 
not adequately icentify behaviors necessary fer prometion 


and consequently does not stroke vosit+ Viozr. AS a 


8 
< 
(Db 
Cre 3: 
D 
to | 


a 
Mesagic, 2t Shoule come as ho Surprise that thers is an over- 
© 


whelming felt need for improvement or change to the OPMS. 


for Un. torn: t 


The analyses reveal ungquestisnebiv that the OPMS is 
percieved tc be applied to the o 


ft 
Mieeeorm Tashion. The officer corps 
e 


application of tre OFMS is a Function sf grads, career 
Pietra, and district cf assignment. The author will not 
debate whether this belier is based in fact or not. The 
reality is that the officers believe it to be true. This is 
a devastingly detvisive perception that may have negative 


memecaquences not only for the OPMS, but for corps unity as 
well. 


2- Payback 


The analyses of the data support the position that 
feemornsS 25 not worth the time and erfort it Fequires, that 
O 


the organizationzl payback for using the systen d 





Hester 2ts Use. This perception cf the officer corps nay 
prevent the OPMS from being accepted as the thing +o dc. The 
OPMS in its present form may take a back seat to more 


rewarding tasks. 
ee On 2 Y 


The analyses of the data support the position that 
there is not enough time for the naw priorities na 
the OPMS. This system hinders tne performance of other 
Primery and colléteral duties performed by the senior c¢rfi- 
cers polied. The OPMS will likely be piaced on the 


proverbial "back burner" as intervening priorities cverti 


ey 
@ 


the demands of tke OPMS. 
i. Organizational Context 


The analyses of the data support 12 =D 


© 
miemOPNS 2S only noderately well fitted into the oruvanize- 
feel Context of the Coast Guard. While there appears to be 
moderate support for the OPMS in the supervision and grouth 
mame =iOns, “here 1S abject cpposition to the system in the 
selection and precmotion functions. The OPMS must be nore 
Mises y ~allored to the organizational context of the Cceast 


Guard to gain greater acceptance. 


wee BULLY 


The a@palyses of the data Strongly support the posi- 
muem that <he OPMS is inherently unfair, even at «his early 


cf 
$5 


ie 


€ 
Stage, because of the widespread confusion concerning 
b 


° 

impacts and uses of the numbers and the Iimited under- 
standing by the corps of the value of numerical marks when 
assigned. This issue of inequity must be viewed in the 
greater context cr the links among performance evaluation, 
promotion, and the career impacts of successive non- 


election. The Officer Fitness Reporting System, which was 


CO 
ep) 





replaced by the CPMS, was replaced in a large part due to 
+hese issues. It is inappropriate to bridle ourselves with a 
massive appraisal system that is not at least incrementally 


more effective in this dimension than the one it rep aced. 
6. Reward siructure 


The analyses of the data support the position that 
che officer ccrps does not know what performance is neces- 
Bary for promoticn and that the OPMS does little to foster 
the type(s) of performance desired by the service, since 
that performance is unknown. Behaviorists téll us that it 
is appropriate te strok2= desired behavior in order to rein- 
Force that behavior. This appraisal process does not stroke 
desired behavior, largely because that behavior remains 
undefined by the OPMS. Behavioraliy anchored rating scales 


(BARS) have nozt kad the desired effect in this regard. 
7. Need for Change 


The analyses of the data overwhelmingly support che 
Bes t2On that there is a felt need for change to the OPMS . 
Exactly what charge and when is uncisar. However, the 
Pewee ous SX dimensicns certainly reflect conditions that 


are ripe for improvement The perceptions of the corps, 


whether accurate or net, are truly what will drive this 
appraise systam +o success or failure. It is rot too early 
at this pceint to focus attention cn apparent trouble spcets 


a 


within th2 syster. 


Seeenadcike TO GO FROM HERE ? 


The preliminéry analyses of the data collected by this 
Meseatch effort indicate the foregoing conclusions to be 
Substantially supportable. Additional, in-depth analyses of 


these data mos* assuredly wili support the conclusions 
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implied herein , It zs hoped and intended that the Coast 
Guard Heedauarters (G-OPES) staff will use *+hese data for 
the betterment of the appraisal systems to the collectives 
qocod cf all Coast Guard officers. This research project 
reveais the collective response of a highly representative 
Sampie cr the officer corps. Their frank opinions should not 


go unneeded. 
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RPPENDIXZX A 


OFmSe sTuUDY>s THE SURVEY 


Ent EOUUCt ION 


Thank You... | for TOGnde cheer ile COmpateacePace in this 
SUDVEy. Hcpet Uldy, liwwige not require more than 30 minutes 
eo, complete. 

We would like to have your FRANK RESPONSE to the 
following questicns. These questions concern the 


peenct o> of tne Officer Performance Management | System 
(OPMS). We hope to_learn of your present Reactions, 
Attitudes, and Knowledge concerning this systen. 

mie ohtOrmac:on Gained from the analysis of your 
responses wil € used at Headquarters to evaluate the 
erfectiveness of the Officer rerformance Management System 

OP MS 
Additionally, VOUT Eesponzges wiil form an essential 
mommech OC. a beSiearcn BroOlect a= che Naval Post pot aguey® 
School, Nermc=se va eae cor oweants Project is being 
pemducctec by a Ccast Guam Officer. 

You have been selected through a random precess. This 
process intends to sample the opinion of a@ representative 
mepes-SeCtion cf active duty Coast Guard Ofiicers. 

peus FespOnsss Will be (7) Anonymous _ acy 2s 
Gonte dential There is ns mechanism inciuded in this survey 
desi gned =o ink the Tenarks hack to the individual naki rag 
thesé remarks. 

Knowing ~his, we hope you will be encouraged to make 
frank and honest responses +o “ne questionnaire. 

_ We will ask you for_some limited demographic infcrma- 
eo 0. Gee bo teed (eo vetedate =h- Sampling process. 
mers 8MpOrmant tO US <O Know tae type sot officers 

Be=sponding to this survey. This information will have no 
other usade.. 

Bea Clarity, ene Wse oz abbreviations in this questic- 
Memeo i= i:nited. The foliowing terms will be abbreviated: 


Citicer rerformance Management System OPMS) 
Creeeat sup pos. For mt Sen 
Officer Farfczrmance Report OPR 
Leadership and Management Schocl LAMNS) 


Shank wou 
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Demographics 


Please indicéete your 
questions and sukquesticon 
parentheses (__). 


O gio een Beer Cw lig 
ne - check mark in the 


wis 


Example 


What is the color of your eyes? 


(3) Blue (43) 

(b) Brown (593 
{3} Green (33} Miss 
d) Other (Please Specify) (One: 101 


(1) What Tomuiarey yous oresent =ole({s}) in the OPUS 
process: 


My rele includes action 


(a) as tke BOL Oes 4 GOnvOl ti Car, _f127) 
the Supelvy sing Gg 7ticer. 64 
ie} ae as ESper Ling Cie CST « 4 
i the reviews Crmicots 55 
€ Othe= (Picass Epes Gut) 01 


— ES a a a ee ee ee ee ee es es ee mS ee ST ee iS Se ee ee eee 


{2) Hew many reporting cycles have you ccmpleted? 
a) one cycle ree 
Dm wo Cyc les ile 7} 
(Gime ces Cycles 23 
Gere s ss) yee rst crcle, (07 
. Shere (olen eeren=ceaa) . 101) 


a ee ee ee eee eee ee ee ee ee ee ee ee ee eee ee eee ee 


ES ee eee ED ae a eG ees ee ee SS SS eee ES SS See ee es ee ee SS ee ee SS es 
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(3) Ir general terms, what is your area 
specialty? 


OC ON UN FCN 
UD SIO 8 OCD ~3 00 


ih 


Gimeoliarcce Oparat2=ons 
b) Aviation 

Cc Engineering 

d) Marine Inspection/Proztection | 

¢) Manpower/Pers/Training/Education 

a Pea 2 oe Ce 

B perce (Please specify) ( 

(4) Where is your present assignment? 

Atloat (40) Asnore (225) 

Duties ASSignead: 
CO 2) RO(19) 2£O (04) OfS(07) CIFOPS(1¢é 
DIVCH (24) BRCH (22) DEPSRCH (30) OTHE 
(5) What ics your present grade? 

(a) Captain PAY) 

b) Ccmmander ne 

c) Lieutenant Commander 86 

d) Lieutenant : 62 

e) Lieutenant(junior grade) 64 
Ei By eee fl 10) Mis 
g) Warrant (W1 through W4) (00) 01 


(6) HOw feny Offence rs do you “report. cn as 
visor? 


a a (Please enter the correct 
None (130) 

ies. <3 ( 83) Miss 
Mere than 3 (°51) 01 


(7) Hew Many oLrticers do you report on 
Boponr tan ¢ Ot f2cer? 
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number) 


Gm 4 





1-3 ( 27) 
Y= 6 { 23) 
More thar 15 (05) 01 


_,. We do not desire any further demog 
TUSotesetecase CONnzinue on to the next 
survey. 


apn2e in 
ecticn o 


bhrh 


raphi cria- 
secti <7 s 


n 
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Survey Luseruecs LOnS 


SharweeiOUe.6fO05 COmMing his far in the survev! 


If you do not wish to continue, please seai th2 
edg@2 of the survey bookiet and return it by ma 
we will tke sorry i£ vou. don't continue. We si 
Wish to thank you for the data that you have 
provided at this point. 


read on. You 


n se . 
vant and though= 


pete -¥ Cuado ewes tc cont 
Wil Paneer che qWestaons «t 


DEC VO K- Ge 


Qo 
~ 7 
ad : 


a 
(Di 


inu ea 
Oo b le 


Prem lLecuLeowingeqlesc Ons dsc des: Ggned to captur 
VOU ene oem ons MCh Stag. Crey 2n SCOLINgG t 
data, most quest- ions have multiple-choice 
answers. You may select as many or as few of t 
responses which appiy to you. 


Ho 
(D 


In the event that we have not been able to 
include an appro~ priate response option, piease 
provide @ narrative comment which best describes 
yeur lesponse. Space has been provided at each ques- 
On LOG iets Our po Se. 


POL ene Ghessl ORS teat =oll 
check ( ) in the paréentneses t 
ycur resrfonse. 


OW, 
Nat 
Pleasé write any additional comments directly on 


the survey fcrm in the space provided. 


RGave, ohantk YOu. 
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Seeceaon I 


oi) Censidering all of your ¢xperiences so far 
(ae wom os Proce ss,;wnac 2S your OVerall reaction 
to the ertire system? 


a) Very positive (10) 

b) Positive 107) 

(c) Borderline S17, 

(d4)} Negative . 53} Wass 
(¢) Very Negative 09 02 


(la) What is the best part of using OPMS? 
Counseling (28) Feedback (76) Other (137) 


Missirg (24) 


(1b) Eow geod is this best part of OPMS? 
(a) Superior. (17) 
iP Cuiesean ding 54 
Gr Execetleon: RI 
(dq) Verv scood ug 
(¢) Gco ; 2 eee SS 
(Slee seacecel ine 19 


(iG e f2s tie wGese Dart of using OPS? 


Paperwork (33) Time (108) Gener (160) 


Missincg (19) 


tld) em, Beadets eass worst pant? 





(a) Extremely bad 2 

b) Very baa 43 

Gre sea 36 

dim Unsacis ftactony 4‘ 

(2 FOO: Jo) ALS S 
it) Eordserline 34 10 


(2) What are _your overall rea 
a tyes owne £Oll Gwing docunen 
how <0 usé and operate the OPMS? 


Desk Guide 
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2 Very positive (39) 
b) Positive 152) 
¢) Borderline 50 
a) Negativ2 |. 08) MISS 
€) Very Negative (01 AS 
COMDTINSTR Tolls #0 
(a) Very positive (18) 
b) Positive (136) 
ey) Poudemisne 87 
d} Negative i Mass 
e} Very Negative (03 10 
(3)in qeneral, what is your reaction to tne 
Clatiue GuaemeeeeronS previdsd by the toliowln< 
document ¢? 
Desk Guide 
(a) Very positive (23) 
(>) Positive 164) 
c} Borderline 54 
ad) Negative. 06 yl TS Sys. 
e) Very Negative (01 di, 
CCOMDTINSTR 1611. 10 
(a) Very positive (13) 
b) Positive 143) 
c) Botderiline 87 
ie Neqatsve . 08 Macs S 
2) Very Negative (04 
(Cee cecal wnac §s VOUT react: on to the 
OVerati €OnSiStency,cor the dieections and guidance 
provided bv tnese two documents? 
(a) Very positive (9) 
(Dj) Positive 17 2) 
©) #cexrderline 63 
dé} Negaciva 07} MISS 
e) Verv regative (9 1 12 
Pe omeieregenetal | whet fas been your overall reac- 
ion to, the teedback you have received during the 
Svalicuer Gime Vere @(>7X NOMmthnS).. 


from your supervisor? 


Very positive 
POSitive 


Very negative 


Borderline 
None received 


(a 
(b 
S 
; Negative 
e 
af 


PECheNOQULT weep Osc ong Officer? 


89 





OS) BeOS 

Og Gaye 

Negative |. 

Very negatil 
= 


ya 
Nene received 
ax 


Very positive } 


thm QQ of 
Pee ae 

= CCD ih 
mb WO ONE CD 


} 
(6) Ir,general, wh iS 5yeu 
the negative feedback you may 
your eva IasVonwey cise. 


from your superviscr? 


(a) Ver ositive 
D Positive 

¢) Bordsrline 

d) Negative. 

ea) Very negative 
ton cere ce. VEC 


as KI ~3 CO 1D OO 


ee ae! == 


ant Cand KOO ad 
“ae 


O 
Kh 
th 
ft. 
G1 
(b 
me 
») 


from your reporting 


) Very positive 
POscicaye 
BOLCeEr Lo 
NG cue am.» 
Wen sloda ave 
NeWemrEece. veg 

ze 

a 


= 


» 


PO Ign, ling, gp tin pti, 
IMO UI U1O 
Upon 
ee er eee 


“4 


-géeneral, what 
tive feedback yo 
Mec 2 Chmey C lew ss. 


ui 
Sb 
me, © 


ee V eed rb 
have receiv 


Gh 


a 


from your supervisor? 


Very positive 
ROSt*z2iVs 
Borderline 
NeQGetive . 
Wery neqat is 


eave 
None recéelvecdc 


thiDd uQ or 
a te ee ee ee? 
ey pom, FO 
U1 O 4 as LO 
= 


WwW WL 


Oo 
tty 
th 
ae 
C 
(i) 
1+ 
») 


Peon myOn = elo Oe G 


Very positive 
POSITeELvs 
Borderiine 
Negative 
Very negat 
None recel 


rhop uQ orp) 


fv + 3 tii atti at aati al 
) 
“4 


OO f~)N 


ieee 
wm DM 
(D ppp 


‘Oo YQ 


a LPO, gin, Jy, gin, 
rj 


Wty 
Purt 
oO oOo 
eee 
t3qt 
Ors 
He @ 
rhO 
tho 
t4-Q 
ANS 
(D 
ie 


ct a fat sr Fa I ong, Ee, 


(D th 
4 

by tee, 
O p’o 
Ho~ 
OO ct 
b4 f-}-- 
+EO 
M Pus 
pu D 
1c 
QHA 
mo QQ 
MOG 
*JIrhKY 


tO 
de i 
WD f'- 


Very positivs 
Fositive 
Borderline 

ie Ciche Ve 5 
Very negative 


ee? 


re 


ili, silin, atin, Py, dln, 
db —aQ on 
ge ene gael Saag 
WnNGn~j ~) 
ee ee 
Ole 

tn 


gy, A, gin, on, 
O-N1— ) 
WN 
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Gjeeteimwculdsyou dsserrpe the skill? of your 
superiors in providing the feedback you have 
received in tne OPMS cycle.. 

your supervisor? 

a) Very competent 31) 
b) Competent 10 1) 
c) Borderline Te 
dj) Incompetent 16 
e) Very Incompetent (05 
£) None received Bia 
vOut mre DOrcEng so LEJcer? 

a) Very competent Bie 
b) Competent i 1 
c) Borderline Soe 
d ie Cup eee a 07 
e) Very Incompetent (05 
f) None received a2 

(10) Eow_much training on your _OPMS duties have 
you received from the Coast Guard? (Sl#ase 325t1- 
mate.) 

Nee KSuuee DAYS. 2 HCuUrS 


(10a) Where did you receive this training? 


(a) CG TRACEN L.A.M.S. (08) When? __ __ 
(b Ope Welice clon. soon let) 
iS Giese re JCD trai rin 12 
d) Coast Guard Seminars 87 
(e) Other, please specify (14 
COmparattcn (31) 
No training received (02) 

_ (11) ,Fow mucn training on supervision and evélua- 
MOMS tee Ne Ord n. Clples sof cee and gozl 
setting have you received from the Coast Guard? 
(Please estimate.) 

Weeks Days_.__ Hours | 
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Gulcweenietre ald you recezve this traelinind? 


(a CGe CeAGan LOAM. S. S13) 
(b Implementation. team ut 
(Ee Oren] 7eb training 20 
(d) Coast Guard Semirars 43 
(e) Other, please specify (19 


Comoa tae. On, 7(28) 


No training received (82) 


(V2) eeu, much. trai Meng On intezpersonel reia- 
BHOUS, Cann eeeoc our: On, OF COuRSeiing techniqu 
have you Boece from the Coast Guard? (Please 
estimate.) 

Weeks___—s—séDaysS__—=—s—CsdWOTS 
(12a) Where did you teceive this training? 
(=) Comin tL. Ae. S. (59) when? 
2 PE eo) team 18 
Cc tae Fon <fallind 17 
eouee c Guard Seminars 26 
Gonoe ep hed-aucp=city (36 


Cone tacuon, {35) 


No training received (72) 


(13) In generai, how would you describe this 
mace nond Overall? 
(a) Exceptionally good (53) 
(b) Somewhat Bas 87 
(Cc) SO=s0) 4g 
dj) Scemewnat OOr 22 MESS 
e)  Exceptloneliy poor 14 a5 


(14) in AS tee ee fo) VOUGmm@cectLOn tO cane 
edequacy gen the 222 iaing? 


(a) Very adeauates (30) 
(b Adequat¢ oS 
(cjeececea eri ane 58 
(a Tnadequate o> ESS 
(¢) Very Inadequate 22 27 


32 


—_ a ba 2p ae aap 





(15) How would you describe the effectiveness of 
the trairing you have received on your OPMS duties? 


3} Very affective (05) 
(b) Effective 115) 
(c) Borderline 92 
e Ineffactive . 34 Mee SS 
e) Very Ineffective 11 08 
(16) Eow would ycu describe your current level of 
Het i1)Gesedd sseeicpeyOUS COUNSe Ping ab@eappraisal 
duties? 
(a) Very adequate (22) 
(b) Adequate 106) 
(c) Borderline 77 
(d} Inadequate 40 MISS 
e) Very Inadequate 09 11 


(17) Fow would you describe the ability of your 
Saree mG masee= an Deh sOum=n¢ his OPNS counselling 
and appréisal duties? 


(a) Very competent (29) 
(b) Competent 108) 
Gy Eondesi ine 87 
d) Incomvoe tent i SS 
(¢) Very Incompetent is 07 
» Pieéase 2ndicate the degree to which you agree or 
disagree with the tollowing statements oy volacing a 
Cmeck Mark  (  ) £0 Ghee appropriate vdaltenthesis. 
Cicjmivel LeusStret=sd when I “ry to get definitive 
answers concerning the significance ci the numbers 


on tne OER. 


(a) Stroud Ly agree (34) 
(b Agre2 69 
is Neuzral 80 
ee lasagee S 7 20 MESS 
(e) Strongly disagree (08 04 
(19) In general , the amount of time required for 
my OPMS cuties has not béesn excessive. 
(pec eEOngd Ly 2gre=2 (20) 
(} Agr2e (8 3 
Cc Neutral 32 


ge 





2 Disagree 
(e) Strongly disagree 


20) In general, the number 
not excessive. 


(a) Strongly agree 


(b Agres¢ 

(c Neutral 

(d4) Disagree _. 

(e trongly disagree 


(93) "5% 


Gemoriacers [| Super 


PP fy, pn, 
OOWNO ~) 
“IWNO & 





See ieinegenerel, chesnumbes Of CEficers I super- 
vise andyor report on is about right 


~ @ 


{a} Strongly agrees Bal} 
(0) Agree 74 
(< Neutral 82 
(d} Disagree _. Ze fe tSS 
(fs) Strongly disagrees (13 44 


_ (22) In general n my Superiors have been able to 
devote @2nough time to m2 to aeet my OPMS needs. 


(a) Strongly agree (12) 
b Agre2 he 
e Neutral 47 
4 Disagree ti 
e) Strongly disagree (54 
_ (23) Fight now, OPMS takes too much time to do it 
sg Lleflehne 


(a) Strongly agres (103 
te Agres 123 
er Neutral 43 
(d} ey 
(e} 10 


Disegreec .. Poko 
Stponmgity disagrees 10 
Coe OnianO Wee fT sealiy Like using <ne OPMS for 
GOUNSELL IS ara Sugervising but ©T dc not Liks tne 
mieasef Gerd fc mS 92) basis’ for promotion. 
(a) S2Ecig ly agqres (27) 
2 Agre: 54 
(c Neutral 90 
(o Desag.ce ._. 3 wssS 
e, Strongiy disagree (26 05 
(2s) Ioan confused coneerning the impact that the 
numbers cn tne OPR have on the promotability of 
Car ueer Ss 4 
(a) trongly agree (102) 
eB Agree 10S) 
(C Neutral Be 
tt Piseagse o 9) 19 MESS 
(ce) Strongly disagree (05 O02 


G5 





Section fi 


Please indicate how yeu feel concerning the 
followinc statements. 


(1) The OFMS is a geo 
plish per~ fcrmance eval 


ae eT) 
vt x, 
ee © 
be 


(a) Strongly agree (17) 
e Agree (108 
(c) Neutral 68 
(d) Disagree 47 
(e) Strongly disag Ze 





{ se of the OPMS iS a good way to select 
Gudwliitcee OLELCSrS [Or PLOWOTLOn. 

(a) Strongly agree (33) 

(b Agree 833) 

(Cc Neutral 81 

(d Disagree So MISS 

(e) Strougiy deasagtee(27 02 


(3) The OPMS provides mé with the information 


=hat need to pericrm my cuties. 
(a) Strongly agrese (28) 
(bp) Agrees 106) 
(c douse s ug 
(d ESager 2 ae, 
(e Seonel ¢ disagrees (21 


eo) BrSEBOlPNS SOrOViceso we with the information I 
neeqd to assess my promotion potential. 


(a) Strongly agree (05) 

2 Aqres 43 

¢) Néutral ay! 

: Desad56 2 1904) MISS 
e) Strongly disagree (57) O02 


(5) Tre OFMS will provid]? the promotion boards 
with the infcrmation heeded to fairly and accurately 
promote qualified officers. 

(ay Strongiy agree (08) 
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Agree 

Neutral 

Disagree _. 
Strong. yy. di Sagree 


oy 





(Oo) Auer NceyeeerCr2 on Of tac OPNS is tc provide 
aeGurat Cue Oemecson cO help... 


(Qjepeeuerson podrds to select qualified otficers 
(Oe eee erek(ol i (50) 

(b>) assignment panels to seiect qualified offi- 
Gems shoe fapOeODs ace Posi tLons. (06) 

(c) detailers to make assigment decisions, (05) 

(d) provide perftormanc?, feedback to enhances the 
DerscOnalwg@EOwen Of the cfticers corps. (7107) 

(©) Other (Piease specify) (10) 


Combiraticn above ( 92) 


Missing (01) 


(Saueerte OmemInece On Chleths OPMS is <= 


he most 
LMPpeLten< tO Vou? 

(a) Promotion boards (92) 

(b Assignment panels 18} 

1S Dermal ten's cd=casions 06 

(d Performance feedback 128} 

(e) Other (Pisase specify). (08) 


Combiraticn above (20) 


Wess2 ng (01) 


Me Quel o Nw OENS Ss0W2ces5a fretr end accurate evalua- 
tion of Ly past pertftormance. 


(a) Strongiy agree (0 
2 Aqres _ 1 
c¢) Neutral 6 
(Cc 4 
(e 7 


On 


) 


Disagree |. 
StrOngLy aisacgres 


UID OVW ~J 


NSS 
15 


e OPMS provides a fair and accurate assess- 
VenUTUbS PpOotenticl as a Coast Guard officer 


(aye oat Ongiy aguce (96 
(0) Agree | 73 
(Cc) Neutral 70 
67 
7 


(4) Disagree Ay Ss 
(e) Strongly disagzree 06 
1) MremOlNS is being epolied uniformly to ail 
grades of Ceast Guard Officers. 
(a) Strongly agree 01 
ny Agree 394 
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(Cc 
(d 
(e 


neues 
geSSaa§ 
ngly dis 
isagres 


| 





MeO Li att 


(10) The OPMS is being 
icers. 


D 
career fields for Coast Gea 


fui 
+3 
Jel eat 


Sipe 
ar 


(Se tongiy agree (01 
(b Agree 344 
(Cc) Neutral 116 
(4) Disagree en 
(e) Strongly disagree (47 


(Uiyeetnes Glia 2s be2rpg apolicd unzrormly in ail 
duxy assign- ments eeeeneaoe the Ccast Guard. 


(a trongily agree (00 

(b) Agree : ea 

is Neutral 106) 

d) Disagree 66) MiSs 
(ec) Strongly disagrees (59 18 


fhewaecGumen tactOn and InSesuctions provided 


(1 
with fhe OPMS assure there is no Confusion in 
dsoo0ntne Bumcr2cal evaluations to Coast Guard 
GCfricers: 
(a): S= -rongly agree (03) 
(b) Agree be, 
(c Neutral Se 
(d Disagree es) YESS 
(e) Strongly disagree (43) O2 
(13) I have been abie to find See eee ony 
answers to ali ny questions concerni ene lite 
Leola Weitcen LN StEUCtLONS vDrovi ae With the 


SYSTEM. 


Sesongly agnues 03) 
: Agree 79 
¢) Neutral 64 
2 Disagree 443) wl esp 
e) Strongly disagree (13) Oe 


(13a) The Headquarters (G- OPES) Stati nave been 
DewpeWl 2n DPEOViding SatiSrtactOry enswers +o the 
questions I have poSed to then concerning che OEMS. 

(a) Strondiv agree 07 
Ke Agree 23 
¢) Neutral 57 
ic Disagree 18 
ey oe TOug Jey disagree 26 Mss 
(Ff) Dees not apply to me (122) 02 


(14) The trai 
of OPMS jis all 
career. 


om MG ieee Weeene lt lAl Stage 
hhat Wild be required by ne in ny 
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dDAqdoD 


Strongly agree 
Agree 

Neutral 

Disagree _ 
Strongly disagrees 


101 


U1 a = UO 
ONWN & 
baa. © © 





(15) LOPE eme moran anG LS required for me tc 
perform my OFMS due ies. 
(a) Strongly agree 07 
ib) Agree 163 
(c) Neutral 44 
(qd) Disagree _. Me) iss 
=) Strongly disagree (34) 02 
(16) No further gery cane is required for my supe- 
SHOES TOmper tos =1e2> GE2NS duties. 
(a) Strongly agqree (03) 
(6b) Agrees 22} 
(c) Neutral 64 
(d) Disaqree 106) MISS 
(e) Strongly disagree (54) 


(\7) Nee i urencc tra 
a 


128 ning Dome qiirbed, for my 
JUnBOLS Wee DSELOnn iA E 


- 
PesOPnS~ dunes. 


(a) Strongiv aq (03) 

(b} Agres 29 

(c) Neutral 65 

(3 Disagze 105) MISS 
@e) Str ang1 Y diseares (38) 25 


(18) My questions concerning. wee Of =he OPMS can 
ke resolved by my immediate rating superiors. 








(a) Strongly agree (91) 

(b) Aaree 53 

c sere 79 

a isagree |. 105) Nios 

€ Senay disaqree (28) 03 

(19) My questions concerning use of the OFPMS can 
be resolved by Commandant (G-OPES Stazf). 
Strongly aaqree 08 

2 Agree 81 

¢) Neutral ye 

fe Disagree 34 Ess 

e) Strengiy disagree {05 3 


(20) There is no confusior coneeeae dg the assign- 
ment of rumerical evaluations on the OP! 





(4) Disagree |. ( 
(e) Strongly disagree ({( 


(Zieeicwemnoemg less: ONS COnGCerning the impact of 
numbers aessigned on my OPR. 
(a) Strongly agree (04 
(b>) Agree 19 
is Neutral 19 
d) Disagre2 _. Zh ESS 
(e) Strongly disaqree (93) Q3 
(22) I have no,questions concerning the impact of 
2ne NUuUNbDers LT assign to my OfLiicezrS OR their OPR(sS). 
(a) Strongly agree (92) 
(bo) Agree 10 
(c) Neutzal 68 
(d) Disagree 83 Mess 
(e) Strongly disagrees (62 4) 





23) As a counseling ana developmenter tocl, the 
OPMS is a gocd method. 
(a) Strongly agree ae 
b) Agree | 147) 
ey Neutra. 27) 
(d) Disagree _. Oo eae 
(e) Strongiy disagrees (04 03 
(24) The time and effort I spend on documenting, 
counselirg, and Beedback wlth my QGuniers are wort! 


aw Ww’ @ 


(a) Strongly agree 34) 

b) Agree GZ 

¢) Neutral io 

(je) Head e So Cin 40 GESTS 

( Strongly disagree (12 ie 

25)eetee <ame and ef fore [T spend on documentin 
aounee img, and fesdback with ny Sipe sos are worth 

(a) Strongly agree 42 

(o>) Aaree a2 

(c) Neutral 54 

d) Disagree _. 2)5)1 De te Esp 

e) Strongiy disagre2a (17) O7 
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(26) generat the GPNS pays beck what i put 


eo Lt. 

(a trongly agree 

(b) Agree 

(c) Neutral 

(ce oe S—5- Ke Sol —5 

Sleeserong iy se: Sagzec 

fe) I have enough time on 

OPUS dutvaes. 

(a) Strongly agree 

(ob) Agree 

3 Neutral 

d) Disagree . 

(¢) Strongly disagreée=: 


28) The performance of 


m 
mene che performance of my ot 


Strongly agree 
Agree 


b 

e Néutral 

(d) Disagree |. 

(e¢) Strongly disagree 


ANIU1IW & 
Nee et See 


Pa Pn gtn, gli, spin, 
hODO0Or1V~) 


my job to perform my 


(16) 

108) 

Sie, 

56 Ss 
4u8) 02 


OPMS duties does not 
ther primary duties. 
(20) 

108) 

Be) 

62 iss 

36 Q2 


The performance of my OPMS duties Goes not 


29) 
uncle tte performance of mv ccoliateral 








dite s: 

(a) Strongly agree (19) 

(Db) Agree 101) 

(c) Neutral 7 

(jj) Desagqree _. bz Wiss 

(¢) Strongly disagres (36 03 
. (30) fy superviscr has taken enough time with ne 
to ke abis to compiete the reports required by OPMS. 

(a) Strongly agree (07) 

b) Aaree 23 

Sveucca 1 aE, 

jeu esagae 6 71 Hess 

(fe) Strongly disagre= (37 O04 

(31) I am confident that I will be promoted if I 

typically receive three's (3's) as a@ numerical mark 
Onwimy Ciiveer FerrOoOrmance Xeport. 
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CAH 


Se ee 8 eet ame Sat 


(32 





(35 





(35) ¥ 
as requir 


nak 


lod net nae 
stretching my goais on th 


pat ecchala ene iu 
still be selected for promotion even if 
reach all of his goals as 


ave established the 


Stmongihy agrees 
Agrees 

Neutral 

Disagree . 
trongly disagree 


Seis a iG... 6 
2 


Strongly agree 
Agree 

Neutral 

Disc Giae 6 i 
trongly disagres 


Strongly agree 
Agree 

Neutral 

Disagrse 
Strongly disaqree 


that ar 


Sead ced on 


(3 
9 
=. 
6 
Z 01 
individuai would 
he did 
Tie OSs. 


} Liss 


ner 


proper Tapp Stowe a 


cx to receive an accurate pertormance 


Strongly agree 
Agree 

Neutral 

Disagree |. 
Strongly disagres 


Strongly agree 
Agree 

Néutral 
IB) geyek (0 page. 
Speseio lene (al 


(36) No improvements to the OPMS are 
= 


a 
y disagrees 





(25) 

136) 

57 

Fe yi SRS 

a7 01 
S=neomG Has OPMNS duttes 

(20) 

104) 

46 

Si WESS 

fe 01 


necessary +o 


it an effective tocl for performance evaluation. 


(2 
( 





0s 


00 
18 
5 








(d) Disagree _. 
(e) Strongly disagres 


cep No improvements to the OPMS are BCG See to 
Make it an effective tool for selecting qualifie 
Cea teceGs BOL PrOmouion. 

(a) Strongly agree {O02 

(bo) Agree 16 

c) Neutral 58 

d) Disagree . Valo) Mess 

(ce) Strongly disagree (76) 03 


(38) Immediate Lmprovements.+o the OPMS are 
iece= d aeommarCm con Co secCcRVC_ TOO) Tor Sseleceang 
Gicitrle oc Orhecens LO" Promotion. 


(a) Strongly agrees 

b) Aaree 

c) Neutral 

(d) Disagree _. 

(e) Strongly disacres 


OWO~ IN 
OMmMOowWN 
—* 











, 39) AS an organizaticn, we are woe ae ens achhee 
thing by using this system (OPMS) for developmént 
and Supervision. 

(a) trongqly agree (45) 

(D) Agree 25) 

(Cc) Neutral 4 8 

(dq) Disagree 35 MISS 

(fe) Strongly disagree (11 01 
eck AS an organization, we are doing the right 
Pied oveuatrg wena s Ssyscem (OPMS) as tne basis for 
promoting qualified officers. 

(a) Strongly agree (14) 

e Agqres 66 

¢) Neutral 94 

(id) Disagree 65 Wiss 

(e¢) Strongly disagres (24 02 

(41) Fanagement by objectives is an appropriate, 

approach to military perSonnel management for use in 
the Coast Guard. 

(a) Strongly agree (39) 

2 Aqree boa) 

ey) Neuceat 51 

Bs iD) WS jeKe a) 133 WIE Sys) 

e) Strongiy disagrees (11 02 
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Section III 


ate Zr general, I know what numerical evalua- 


56 eee my officers when completing the OPR. 


(a) Sueno agree (06) 
b) Agree 44} 
c) Néutral 74 
(d) Disagree |. 34 ys Ss) 
(e) Strongly disagree (09 48 


(2a Ieper gtficers know exactly what mazks to 
expect of the basis of the narrative I have 
Sree)! alta esrel 

(a) Stronaqly agree (02 

(b) Agree 33 

(Cc) Neutral 109) 

(d Disagree 554 als 
(e trongly disagre2 (07 54 

‘3) the reporting crficer knows what numerical 
marks to assign wheh the narrative is properly 
completed. 

(a) Strongly agrzes¢ (03 
(b) Agree 62 
(c) Neutral 94 
inl Daseqce Sy fo jee oS 
(e) Strongly dijsagre2 (11 10 

The fcliowing questicns refer to section seven 
{7) of che Officer Perfcrmance Report, Adherence to 
Coast Guerd Standards. 


(4) A numerical evaluation o: 
24 secticn seven iS an excell 


(a) Strongly agree (03 
(5) Agree 12 
(Cc) Neutral 53 
(d Disagree 148) MISS 
(e) Strongly disaaree (45) 
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(5) Te numerical evaluation of three is what the 
majority of officers should receive. 
fa) Strongly adree (18 
(b) Agree 135) 
ic Neutral 62 
(qd) bisagree | 33 NESS 
(fe) Strongiv disagrees (11 O04 
_. (6) The numerical evaluation of three is suffi- 
cient to assure the promotien of a qualified officer. 
(a) Strongiy éegree (05) 
(b) Agree 30 
(c) Neutral 83 
(qd) Disagree . os). Miss 
(e) Strongly disaaqre=2 (31) 07 


. (peteatecte tot Oo cCoaeeaY KNOW ENnoOligh concerniag 
Soe Weaiue Of Dumerical marca’ to be fair to nyseli 
and others. 


(a) Strongly agree (05) 

(bo) Agree ~ 40 

(< Neutral >> 

a) Disagree | 11 MESS 
(e) Strongiy disaar¢eea (46) 06 


(2 eens Sms cA ea. 2 kndw.enough concerning 
Siew chemo Lunea LC walks tO advise my juniors 
when they have questions. 


(a) Strongly agree (9 2) 

(ob) Agree SZ) 

c) Neutral 65 

d) Disagree One sal oS 

(e crongly disagres (39 31 

(Sem tae kece2CS 2oes Secrion is always written 

by the repofting officer, not by someone else at his 
CiTec tan0 Ie 


(a) Strongly agzres 

(b) Agree ca 

(c) Neutral 

(d) Disagree _ 

(fe) Strongly disagres= 


hyo~J~I Oh 
(fi a J] 4 CO 
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This concludes the question 


> s that are solely 
concerned with section seven (7} o he 


te at OPR. 


(10) My supervisor has complied with the OPMS 
counseling requiraments without undue prompting by 
me. 


{a)) Sereong. y egresc 2 
(Db) Agree 8 
c) Neutral 3 
d) Disagree 7 
¢) Strongly disagree (4 





Wein itiate msd=perlod, 
NG Sess rors were conduc 
ke time limits estabiils 


ner 


(a) Strongly agrees (2 
(b) Agree 7 
(c) Néutral 2 
(Qe ptsagrce S 
(¢) Strongly iisaare= {4 


(12) Sy knowledge of the OPMS 
enermine what performance is née 
ete) “ebeeliu ce epee 


ee 


d 
= 
of deserving juniors. 


Sereeng.y aqgece (06 
Aqree 34 
Neutral oe. 
Disagree 88 
Seecngly disagree (25 


0 mQqon 


rc 96) 
r 42 
=utral 73) 
Disagre2 _. foo), “iss 
Strongly disagwee (35) O04 


Weippe satecentsa: mn C= Ynat ac=itons are required of 
me by the GPMS. 


(a) Strongly agree 13) 

(b) Agree 179) 

c¢) Neutral 33} 

d) Disagree Zo Wess 


I ON, 





(e) eEOuG dy 


(14) I know which 


Strongly agree 
Agree 
Neutral 
Disagree 
Strong ly 


0 RASH 
Cage Seen ee 


TK nCwmw ach Office to 
noses 


HedGacnt tee to resolve 
EQNCeENS ra EnerOris . 


(a) Strongly agree 

(>) Agqres 

(c) Neutral 

(d pees ee 

(e) Strongly disagree 
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disagr¢2 


Circe tC Wel 
=O tesolve ifsues of conflict 


isagres 


(07) eZ 


Domny Ue Steacs 
Gonmcerwing tne OFMS. 
ay 

109 

a5 

73) BSS 
73} 10 
Gail] az 


Op COnelict 





(16) I have the skills that are required to carry 
out ell ay OFMS duties. 


(a) Strongly agree (30) 

(Db) Aaree 153) 

(c) Neutral 36 

dj) Disagree . =i) GLE Sys 
eé) Strongly disagre2 (06 03 





(17) My superiors have the skilis required te 
Garry OUt their OPMS duties. 
(a) Strongiy agree (20) 
(b) Agree 155) 
C Neutral 60 
d) Disagre Soy S> 
€ eona disagree (08 0B 








(18) ¥y juniors have tne skills required to 
Caary Oulceneir OPS duties. 


(a) Strongly agrees (12) 
(b) Agree 92 
(Cc Neutral 88 
(3 isagree ZO SS 
e Seo iG disagree (07 38 


tieseeas the end oOo: the ce ee An additional 
1s provided for your remarks 


Q 


When you have finish¢ ed, please seal tae edge of 
the Sue beoklet with tape or @ staples, and retura 
i+ by mail. 





Ccmments 


Please use the remaining space to provide 
whatever additional comments you may have. 


eae. 
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